AVERAGING AND LARGE DEVIATION PRINCIPLES FOR 
FULLY COUPLED PIECEWISE DETERMINISTIC MARKOV 
PROCESSES AND APPLICATIONS TO MOLECULAR MOTORS 



A. FAGGIONATO, D. GABRIELLI, AND M. RIBEZZI CRIVELLARI 



Abstract. We consider Piecewise Deterministic Markov Processes (PDMPs) with a 
finite set of discrete states. In the regime of fast jumps between discrete states, we prove 
a law of large number and a large deviation principle. In the regime of fast and slow 
jumps, we analyze a coarse-grained process associated to the original one and prove its 
convergence to a new PDMP with effective force fields and jump rates. In all the above 
cases, the continuous variables evolve slowly according to ODEs. Finally, we discuss some 
applications related to the mechanochemical cycle of macromolecules, including strained- 
dependent power-stroke molecular motors. Our analysis covers the case of fully-coupled 
slow and fast motions. 
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1. Introduction 

Several systems in physics, chemistry, biology, control and optimization theory present 
a multiscale character due to interacting parts evolving on different relevant timescales. In 
the case of two relevant timescales, the dynamics is a combination of slow and fast motions 
and often the slow motion is supposed to be well approximated by averaging the effect of 
fast motion, considering the fast variables as locally equilibrated. This is the content of 
the averaging principle, which has been successfully applied in several contests. We just 
mention few examples. One of its first applications has been the study, due to Newton, of 
the precession of the equinoxes (see [5] for averaging methods in mechanics) . An example 
in quantum mechanics is given by the Born-Oppenheimer approximation, based on the 
fact that electrons move much faster than nuclei. Recently, averaging methods have been 
applied also to model climate-weather interactions (see for example [CMP]). 

The validity of the averaging principle has been rigorously proved for several models 
assuming that the fast motion is independent of the slow one, assumption which is not 
fulfilled by many real systems where fast and slow variables influence each other. A rig- 
orous proof in a stochastic fully-coupled case, with additional results on large deviations, 
has been provided by |Vlj and |V2j (the former contains errors, recently corrected in the 
latter). There the author considers a system described by variables (xt, at) € M x N, M 
and N being differential manifolds, such that the slow variable xt evolves according to an 
ODE depending both on xt and a^, while the fast variable at undergoes a diffusion with 
local drift and variance depending again both on xt and a%. In [K] the author has given 
among other an alternative proof of the averaging and large deviation principles for the 
fully-coupled model as above, with the extension that the fast variable at varies in N x T, 
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N being a differentiable manifold and T a finite set, by diffusion on iV and random jumps 
in r. 

We consider here a fully-coupled system whose state is described by a slow variable xt 
varying in a differentiable manifold M (for simplicity of notation we take below M = R d ) 
and by a fast variable at varying in a finite set V. We will consider also the case that 
at evolves fast only when varying inside some subclasses - metastates — of V. We call xt 
the mechanical state of the system, and at the chemical one. The mechanical state xt 
evolves according to an ODE whose form depends on the chemical state at, while at is a 
continuous-time stochastic process with jump rates depending on the mechanical state xt- 
In other words, the system we consider is a fully-coupled piecewise deterministic Markov 
process (PDMP). Our motivation and terminology come from molecular motors, but the 
same model is natural in other contests as for example operations research, control theory 
and optimization (see [D2j . |YZ| ). 

Molecular motors are proteins, hence biological macromolecules, working inside the cell 
at the nanometer scale as microscopic engines, powered by the chemical energy provided 
by ATP hydrolysis. Their tasks are various, as for example they can transport cargos along 
filaments or determine muscle contraction. Molecular motors can be in different structural 
states, that we simply call chemical states: attached to the filament, detached from the 
filament, bound to an ATP molecule, bound to the products of ATP hydrolysis and so 
on. Independently from the chemical state, there is a specific region of the molecular 
motor working as a lever-arm, able to swing and produce work, while the fuel (ATP) is 
collected from the environment and used to derive energy. The conformation of the lever- 
arm can be described by a continuous variable x £ M, that we call mechanical state. The 
above picture is known in the biophysical literature as power-stroke model, cross-bridge 
model and also lever-arm model, in contrast with the so called ratchet model (see [H] and 
references therein). 

In order to investigate the functionality of molecular motors, it is enough to describe 
their state by means of the pair (x,a), whose dynamics can be modeled in a first ap- 
proximation by a fully-coupled PDMP as discussed in Section [3l There is experimental 
evidence that the family T of chemical states is partitioned in subclasses ri, T2, . . . , 1^ 
inside which chemical jumps are much faster (see [D] and references therein). As implic- 
itly assumed in biophysical papers as [VDj . we also suppose that these jumps are faster 
than the mechanical relaxation time scale. Considering first the case I = 1, in the limit of 
high frequency of chemical jumps, we prove averaging and large deviation principles both 
for the slow motion of the mechanical state x and for the occupation measure associated 
to the chemical states visited in a fixed time interval. The analysis for the occupation 
measure is lacking in [K] . moreover we provide a different and simpler derivation of the 
averaging and large deviation principles with respect to |Vlj . |V2j and [Kj. In the case 
£ > 1, the subclasses Tj can be treated as chemical metastates. We then show that in 
the limit of high jump-frequency the coarse-grained process describing the evolution of 
the mechanical state and the chemical metastate of the system weakly converges to a new 
PDMP with effective force fields (ODE's) and transitions rates. In Section we discuss 
some biological consequences concerning molecular motors, while in a companion paper 
[FGRJ we further investigate the model from a more physical viewpoint. 
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2. Model and main results 

We consider systems whose states are described by a pair (x, a) G R rf x T, where 
r = {in, 02, • • • , C|r|} is a finite set. The variable x will define the mechanical state of the 
system and the variable <r its chemical state. 

When the chemical state is a, the system evolves mechanically according to the ODE 

x(t) =F a (x(t),t) (2.1) 

where the force field F a : M. d x [0, oo) — > W 1 is a continuous function, locally Lipschitz 
w.r.t. x. This means that, given T > and a compact subset K, C M. d , there exists a 
positive constant K such that 

\F a (x,t) - F a (x',t)\ ^ K\x - x'\, Vx, x' G K, t G [0, T] . (2.2) 

Below we will specify some additional assumption on F a assuring that the solution x(t) of 
(|2.1|) starting in a given point x G M. d is uniquely determined in each time interval [0, T]. 

In order to specify how the system jumps from one chemical state to the other, for each 
a G T let 7o-(x,i) be a measurable positive function on R. d x [0, oo) and let p(a,o J \x,t) be 
a function defined on T x F x M. d x [0, oo) with the following properties: 

(i) V<t, a', p(a,a'\-, •) is measurable, 

(ii) Vx, t, cr, p(a, - \x, t) is a probability measure on V such that p(a, a\x, t) = 0. 

The mechanochemical evolution of the system is described as follows. Suppose the 
system starts at time zero in the state [xq,uq). Call xo(t) the solution of (|2.ip with 
a = <tq, such that xq(0) = xq. Let t\ be a random variable with value in (0, oo] s.t. 



P(n > t) = exp (- J ry ao (x (s),s)ds\ 



Note that the r.h.s. decreases in t and equals 1 if t = 0, thus implying that t*i is well 
defined. Then, in the random time interval [0, T\) the state of the system is given by 
(xo(i),<To). If Ti = oo, we have done. Otherwise, choose a chemical state a\ G T with 
probability p((To,<Ti | xo(ti),ti), and callxi(t) the solution on [n,oo) of the Cauchy problem 

fxi(t) = F (T1 {x 1 (t),t), t^n, 
\xi(n) = x (ri) . 

Now let T2 be a random variable with values in (t\ , oo] , such that 

P(j 2 >t)= exp y- J 7 CT1 (xi(s), s)ds S j , t>r\. 

Then in the time interval [ti,T2) the state of the system is given by (xi(t),o"i). 

In general, denoting by the time of the k— th chemical jump and by (xfe(t), cr^) the 
evolution of the system in the time interval [r^, r^+i), one has that r^+i is a random 
variable with value in (r& , oo] such that 

-P(Tfc+i >t) = exp ^- y 7 CTfe (x fc (s), s)ds^j , i ^ r fc . (2.3) 

Moreover, Xfc(i) = F Uk (xk(t),t) on [rfc,Tfc + i) and at time r^+i the system jumps to a new 
chemical state Ofc+i G T with probability p(<Jk, Ok+i\xk{Tk+i)-, ^fc+i), while the mechani- 
cal state remains the same, i.e. Xk{Tk+i) = a;fc+i(7"fc+i)- Setting tq = 0, the evolution 
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(x(t),a(t)) is then denned as 

(x(t),a(t)) = {x k {t),a k ) , if r k < t < r k+1 . (2.4) 

Note that the path x(t) is continuous and piecewise C . In order to have a well defined 
dynamics over [0, T], it is necessary that a.s. the system makes a finite number of jumps in 
the time interval [0, T]. We will discuss below under which conditions this automatically 
happens. 

As proven in |Dlj . |D2j . the above stochastic process is a strong Markov process, 
called piecewise deterministic Markov process (PDMP) with (x, ^-dependent character- 
istics (F,p, 7), defined as 

F = {F a } aEV ; p = { p (a,a'\-,-)} aal( . r ; l = {la} aeT - 

The time dependent generator L t reads 

L t g{x, cr) = F a (x, t) ■ V x g(x, a) + j a (x, t) ^ p(a, a'\x, t) (g(x, a') - g(x, a)) (2.5) 

for functions g : M. d x T — » M. regular in x € R d . A characterization of the domain of the 
so called extended generator of the process is given in |Dlj , |D2j . Defining the transition 
rate 

r(cr, cr'|x, t) := "f a (x, t)p(a, cr'\x, t) . 

for a chemical jump from a to a' at time t when being in the state (x,a), the above 
generator can be written as 

L t g(x, a) = F a (x, t) ■ V x g(x, a) + ^ r(a, a'\x, t) (g(x, a') - g(x, a)) . (2.6) 

Since knowing (F, r) is equivalent to knowing (F,p,j), we call both these families of 
functions characteristics of the PDMP. 

Given x, t we define L c (x,t) as the contribution to Lt coming only from the chemical 
transitions at the mechanical state x, i.e. L c (x,t) is the operator on T R s.t. 

L c (x, t)g(a) = ^2 r ( fT ' a '\ x > *) (5 i a ') ~ 9(o-)) , g :T ^R. 
a'er 

For fixed x, t, L c (x, t) is the generator of the time-homogeneous Markov chain on the space 
r which jumps from a to a' with probability p(a, cr ! \x, t) after having waited an exponential 
time with parameter j a (x,t) in the state a (note that here t has to be thought of as a 
fixed parameter). 

We collect here our technical assumptions recalling that [0, T] is the time interval on 
which the evolution of the system will be observed. 

• Assumption (Al): a.s. the number of chemical jumps in the interval [0, T] is finite. 

• Assumption (A2): for any pair (x, t) £R d x [0, T], the time-homo geneous Markov 
chain on T with generator L c (x,t) is ergodic, i.e. it visits with positive probabil- 
ity any state in T, for any starting point. We call p(-\x,t) its unique invariant 
probability measure on T. 

• Assumption (A3): the transition rates r(a,a'\-,-) are nonnegative functions and 
belong to C 1 ^ x [0,7]). 
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• Assumption (A4): each force field F r7 (x,t) is a continuous function in (x,t) G 
M. d x [0, T] and is locally Lipschitz in x, i.e. for each compact subset K Cl d there 
exists a constant K > such that 

\F a (x,t)-F a (y,t)\^K\x-y\, Vx, y £ K, t £ [0, T] . (2.7) 

Moreover, we assume that there exist constants k±,K2 > such that 

\F a (x,t)\ ^ m + k 2 \x\ , Vx G M d , t £ [0,T] . (2.8) 

Only in Section [2T3l when considering fast and slow chemical jumps, we will slightly change 
assumption (A2). 

Let us give some comments on the above assumptions. Assumption (Al) implies that 
the chemical evolution is well defined a.s. A simple criterion assuring (Al) is the following: 

sup 7<r(a?, t) < oo . (2-9) 

cr6r,xGM d ,tG[0,T] 

Indeed, calling c the l.h.s., the random number of chemical jumps in the interval [0, T] 
is dominated by Nt, N. being a Poisson point process with rate c. This follows at once 
observing that, due to (|2.3p . given the random time 7fc + i — is larger that a ^ with 
probability bounded from below by e~ ca . Weaker sufficient conditions are also possible. 

Due to the Perron-Frobenius Theorem, assumption (A2) implies that the time homo- 
geneous Markov chain with generator L c (x,t) admits a unique invariant measure fi(-\x,t) 
to which the Markov chain converges as time goes to oo. If (A2) is not satisfied then it 
is simple to exhibit different invariant measures, hence (A2) is equivalent to the existence 
of a unique invariant measure. Always due to Perron-Frobenius Theorem, fj,(o~\x,t) > 
for each a G T. We call fi(-\x,t) the quasistationary measure of the chemical evolution 
(frozen in x,t). 

We observe that our assumptions imply the following fact: for each compact /C C M. d , 
there exists k > such that 

|r((j, cr \x, t) — r(<j,(j'\y,t)\ ^ n\x — y\ , (2-10) 

\ja{x,t) - J<r{y,t)\ < K\x - y\ , (2.11) 

\fi(o-\x,t) - fi((r\y,t)\ ^ k\x - y\ , (2.12) 

for all x, y G /C, t G [0, T], a, a' G T. Indeed, ()2.10p and (|2.1ip trivially follow from assump- 
tion (A3), while (|2.12p can be derived from assumptions (A2) and (A3) (see Appendix [Cj 
where it is proven that /i(a\x,t) is C 1 in x, t). 

Finally, let us point out some consequences of assumption (A4), some of which will be 
useful later. To this aim we introduce the averag ed vector field F : R d x [0, T] -> R d 
defined as 

F(x, t) := MOK t)F a (x, t) . (2.13) 
<rer 

It is simple to check that the force field F satisfies assumption (A4). As consequence, one 
can easily prove the following result (see Appendix IC|) : 

Lemma 2.1. Let f : [0, T] — > E be a continuous function 
xq G R d , the Cauchy problems 

x(t) = F a (x(t),t)f(t), 
x(s) = x , 



Then, given s G [0, T] and 
(2.14) 
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and 

f x(t) = F{x{t),t) , 



(2-15) 

X(S) = X , 



have unique solutions in the time interval [s,T]. 



Another consequence of assumption (A4) is described in Lemma IC.ll in the Appendix. 
The reader can check that all our proofs work in general for continuous force fields F a : 
R d x [0,T] -> R d that are locally Lipschitz w.r.t. x, such that flZH3| and (p7T5j) have 
unique solutions, and such that the content of Lemma IC.ll remains valid. Finally, we note 
that (A4) is satisfied whenever each F a is continuous in (x, t) and Lipschitz in x uniformly 
in t, namely (12. 7p is satisfied with /C = M. d . 

When |r| = 2 the above PDMP can be used to model motor proteins with two main 
chemical states, for example detached and attached state respectively. In order to shorten 
the notation, we denote by the detached state and by 1 the attached state, hence 
r = {0, 1}. Note that it must be p(0, l\x,t) = p(l,0\x, t) = 1, hence the generator Lt at 
time t becomes 

L t f{x,a) := (l-a)F {x,t)-V x f{x,0) + aFi{x,t)-V x f{x,l)+ 

(1 - aho(x, t) [f{x, 1) - f{x, 0)] + cT7i ix, t) [fix, 0) - f(x, 1)] . 

In this case, the measure 

Hi$\x,t):= — — - nil\x,t):= — — - (2.16) 
7o(x,t) +7i(x,t) 7o(z,i) + 7i(x,i) 

is the only invariant measure ni-\x, t) of the Markov chain on T with time-independent 
generator L c (x,t). Moreover, it is also reversible. 

We are first interested in analyzing the limiting behavior of PDMPs where the time scale 
of the chemical transitions is much smaller than the time scale of mechanical relaxation, i.e. 
a is a fast variable and x is a slow variable. To this aim, we introduce the parameter A > 
and study the evolution on [0,T] of the PDMP starting in (xo,0"o) with characteristics 
iF,p, A7) as A | 00. We call P£ CTo its law and write E^ o a(j for the associated expectation. 
For this model we can state a law of large numbers corresponding to the averaging principle 
and a large deviation principle. 

2.1. Averaging principle. 

Theorem 2.2. Given (xo,oo) € ^ x call x*(t) the unique solution of the Cauchy 
problem 

|i,(t) = F(x„(i),t), te[0,T], 
[a?*(0) = x , 

where the averaged force field F is defined as in ()2. 13j) . 

Then, for any 5 > 0, a G T and for any continuous function f : [0, T] — * M it holds 



lim P A 

A|oo 



T ,-T 



f(t)x(tr(t)=a)dt- / f(t)n(<r\x*(t),t)dt 



>6) =0, (2.18) 



hm P^ sup |a:(t) - x,(i)| >S = . (2.19) 

A T°° VO < t < T 
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Note that the PDMP with law P£ 0t<70 has paths in the Shorohod space D([0, T], R d x T) 
but, as clear from the above statement, in order to describe the asymptotic behavior 
as A | oo it is necessary to think the mechanical evolution x(t) up to time T as an 
element of the space C[0, T] endowed with the uniform norm, and to identify the chemical 
evolution a(t) to the measure-valued vector p(t)dt G A4[0, T] r , where p a (t) = = a) 

and Ai[0, T] denotes the space of finite nonnegative Borel measures on [0, T] endowed 
of the weak topology. This means that p n — ► p, if and only if p n (f) — > p(f) for each 
/ G C[0, T], where p{f) := f Q f(y)p(dy) for a generic measure p. Having in mind the 
above topologies, the law of large numbers states that the mechanochemical evolution 
(x(t), p{t)dt) converges in probability to (x*(t), p(-\x*(t), t)dt) as elements of the space 
C[0,T] x M[0,T] r . 

2.2. Large deviation principle. In order to state the large deviation principle for the 
above PDMP, it is convenient to isolate a special subset of C[0, T] x Ai[0, T] r . To this aim 
we introduce the set L[0, T] of Lebesgue measurable functions / : [0, T] — > [0, 1], identified 
up to subsets of zero Lebesgue measure. Then we define T as 

T := {(x,p) G C[0,T] x L[0,T} r : = 1 a.e. , 

x(t) = x + y j [ F a {x(s),s)p a (s)ds, Vt€[0,T\\, (2.20) 
aer Jo J 

where xq is the starting mechanical state of the system (recall that the system starts in a 
deterministic state (xo,o"o) at time 0). 

The set T has to be thought of as topological subspace of C[0, T] x A4[0, T] r via the 
identification 

{x(t),Pa(t)) temaeT -> (x(t),Pa(t)dt) te[0 T] aer . 

It can be proved (see Lemma IA.2I in the Appendix) that T is a compact subspace of 
C[0,T] x M[0,Tf, and its topolo gy can be derived from the metric d defined as 

ft 



^ V 0^isCT Jo 



(2.21) 



It is clear that for each stochastic evolution [x(t), &(t)) te t T i of the system, the path 

(x(t),xHt) = a)) te[0jT]aer (2.22) 



is an element of T. In what follows we call Q^ Q aQ the law on T of the random path (|2.22[) . 
when (x(t), cr(t)) tg j T j is chosen with law i^ j(TQ . 

Before stating our second main result we introduce some notation: we set 

W := {{a, a') G T x F : a + a'}, (2.23) 

and, given a nonnegative measure ir on T and nonnegative numbers r(a, a'), with (<r, <r') G 
W, we define the function j{"K,r) as 



i(vr,r) := sup ^ vr(cr)r(cr, cr') 
^G(0,oo)r (<T (T , )ely 



1 V 



(2.24) 
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i.e. 



j(*,r):= sup -£V(<r)^k (2.25) 

ze(0,oo)r Z a 

where C is the generator of the continuous-time Markov chain on T jumping from a to 
a' ^ a with rate r(a,a'). We can finally state our large deviation principle (LDP): 

Theorem 2.3. Given (xo,o"o) G R d x T, the family of probability measures Q* oao on T 
satisfies a LDP with parameter A and with rate function J : T — > [0, oo) defined as 

J(x,p)= i j{p(t),r(-,-\x(t),t))dt (2.26) 
■/ o 

where j has been defined in (|2.24p . (|2.25p . 

Moreover, if the quasistationary measures p,(-\x,t) are reversible for the chemical gen- 
erators L c (x,t), then 



J{x - p)= -L\ii^Y LMt) M^^) )dt (2 - 27) 

where < •, • >t denotes the scalar product in L 2 (V, p,(-\x(t),t)). 
We recall that the above LDP means that 



1 

Af oo 



lim sup ^ log Qx a (C) < - J{C) , VC C T closed , (2.28) 
A 

lim inf \ log Q£ 0iCTQ (O) > - J(O) , VOcT open , (2.29) 

AJoo A 



where 



J(S)= inf J(x,p), 5cT. 

(x,p)gS 

Moreover, the function J must be a lower semi-continuous function such that J oo. 

We point out that j(p(t),r(-, -\x(t),t)) corresponds to the large deviation functional 
in p{t) of the empirical measure associated to the time-homogeneous and continuous- 
time Markov chain on V jumping from a to another chemical state a' with transition 
rate r(a,cr'\x(t),t), t being thought of as a fixed parameter here [dH]. As the reader will 
observe, this LDP for time-homogeneous Markov chains will be one of the main ingredients 
in our proof of Theorem 12.21 Other details on the variational problem (|2.24p will be given 
in Section HI 

In the case of two chemical states, since we know the form of the quasistationary measure 
(see (|2.16p ) and that it is reversible w.r.t. the chemical generator L c , the above theorem 
implies: 

Corollary 2.4. In the case of two chemical states, T = {0,1}, the family of probability 
measures Qx ,a on Y satisfies a large deviation principle with parameter A and with rate 
function J : T — > [0, oo] given by 

T 







J(x,p)= Vpoitho (x(t),t) - vW*)7i (x(t),t) dt. (2.30) 
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2.3. Coarse— grained process. We finally consider the PDMP with fast and slow chem- 
ical jumps and study the asymptotic behavior of the coarse-grained process obtained from 
the original one by keeping knowledge of the mechanical state and only of the chemical 
metastate of the system. More precisely, we consider a partition of T, T = T\ UT2 U • • ■ Ul"^ 
where \Ti\ ^ 1. We rename the elements of T by calling cr^i, (7^2, • • • , crj jrii the elements of 
Tj. The probability P '£ aQ is now the law of the PDMP starting in (xq, ctq) with generator 

L t g{x,a) = F a (x,t) ■ V x g(x,a) + ^ X(a,a')r(a,a'\x,t)(g(x,a') - g(x,a)) , (2.31) 
where 

A if a, a' £ Ti for some i , 



\(<r,a') :-- 



1 otherwise . 



Note that the chemical jumps between states in the same chemical class Ti take place in 
a short time of order 0(1/ A), while chemical jumps between states in different chemical 
classes take place in times of order 0(1). Hence, it is natural to call the classes Tj chemical 
metastastes. Below, we denote by 

rW :={1,2,...,£} 

the family of metastates Ti, writing i for the metastate Tj. When the rates r(a,cr'\x, t) do 
not depend on the mechanical state x, the chemical evolution is determined by a time- 
inhomogeneous Markov chain on T with strong and weak interactions and this situation has 
been studied in detail [YZ] . We consider here the fully-coupled case where the transition 
rates of the chemical jumps depend on the mechanical state. As discussed in [YZ] [Chapter 
7] , it is simple to give examples where P XQ ao does not converge weakly as A | 00 since 
the family {P% aQ ■ A > 0} is not tight. Nevertheless, one can obtain from P£ Q aQ a A- 
dependent coarse-grained process weakly converging to a new PDMP. In order to describe 
precisely this result it is convenient to fix some notation. We can write the chemical 
generator L c (x,t) as 

L c {x,t) = L c (x,t) + XL c {x,t), (2.32) 

where L c (x,t) and L c (x,t) are both A-independent Markov generators on T parametrized 
by x and t. Trivially, L c (x,t) has a diagonal-block form: 

/ Ll(x,t) ^ \ 
L 2 c (x,t) 



L c (x,t) 



V L e c (x,t) J 



where L l c (x,t) is a Markov generator on Tj. 

We can now state our assumptions. We keep our previous assumptions (Al), (A3) and 
(A4), while we replace assumption (A2) with the following (A2'): 

• Assumption (A2'): for each i G and (x,t) 6l d x [0, T], the generator L l c (x,t) 
is irreducible on Tj. 

Motivated by assumption (A2'), we write fii(-\x,t) for the unique invariant probability 
measure on Tj, i.e. fii(-\x,t) is the quasistationary measure for the generator L l c (x,t). 



10 



A. FAGGIONATO, D. GABRIELLI, AND M. RIBEZZI CRIVELLARI 



Given ieT^ and (x, t) € R d x [0, T] we define the vector field 

Fi(x,t) := Yj F*(x,t)iM(<r\x,t) . (2.33) 

Given a state a G T we define a(cr) as a(cr) = j if a € Tj, moreover we denote by Rx 0) a 
the law on D([0,T\,R d x T^) obtained as image of f£ 0j(T0 under the map (x(t),a(t)) — > 
( x(t), a(cr(t)) ) (we will often write in place of a(o~(t))). Rx Q . ao is the 1 &W or the above 
mentioned coarse-grained process. Note that in general this process is not Markovian, 
however it converges to a PDMP: 

Theorem 2.5. Given T > 0, as X goes to oo the law Rx 0! a wea kly converges to the law 
of the PDMP on R d x with generator 

L s g(x,i) =Fi(x,s) -V x g(x,i) + ^r(i, j\x, s)(g(x, j) - g(x,i)) , (2.34) 

where, given 1 ^ i ^ j ^ I, 

r(i,j\x,s):=^2 ^2 MiC^k) s)r(a, a'\x, s) . (2.35) 

Note that, due to assumptions (Al) and (A4), both the chemical and mechanical evo- 
lutions for the original PDMP and the limiting one are well defined. 



2.4. Outline of the paper. The remaining part of the paper is organized as follows: in 
Section [3] we discuss some biological applications, in Section [J] we consider the variational 
problem (|2.24[) : we show that the r.h.s. of (|2.26p equals the r.h.s. of (|2.27p if fi(-\x(s), s) is 
reversible w.r.t. L c [x{s), s) and we show other results useful for the proof of the LDP, in 
Section [5] we prove the LLN stated in Theorem 12.21 in Section [6] we prove the LDP stated 
in Theorem 12.31 and in Section [7] we prove the asymptotic behavior of the coarse-grained 
process described in Theorem [23J Finally, in the Appendix we prove some technical results 
used in the paper. 

3. Some biological applications 

In this section we discuss an application of the above averaging principles for PDMPs 
to molecular motors. Further results will be presented in a companion paper [FGRJ. 

As already said, molecular motors (MMs) are proteins working as engines on the 
nanometer scale, they generate forces of piconewton order and are usually powered by 
the chemical energy derived from ATP hydrolysis. Most of them are linear motors, i.e. 
they proceed in a given direction along some filament, which has a function similar to a 
railways track. We refer the interested reader to [H] . 

In the power stroke picture, force is generated by the swinging motion of some part 
of the protein (the lever-arm). In order to study the working of the MM, its state can 
be described simply by the pair (x,cr), where x is a continuum variable specifying the 
configuration of the lever-arm, while a is a discrete variable describing the chemical state 
of the MM (i.e. bound to or detached from the track filament, bound to ATP or to the 
hydrolysis products). Given the chemical state a, the evolution of the mechanical state is 
determined by Newtonian laws as 

m x = - 1 x + F a (x,t)+i{t), (3.1) 
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where 72; denotes the friction force, F a (x,t) is the force field defined as F a (x, t) = 
—V x U a (x,t), U a (x,t) being the free energy, and denotes the thermal force due to 
the environment. Since the inertia effects are negligible and the dynamics is overdamped 
[Hj . one can disregard the term mi. In what follows, we will neglect also the thermal 
force as first approximation. Indeed, contrary to the modeling of MMs as Brownian 
ratchets, in the power stroke picture the thermal force is not relevant for many qual- 
itatively aspects. Taking 7 = 1 without loss of generality, (|3.ip reduced to equation (12. ip . 
Despite our approximation, the thermal fluctuations remain essential in the chemical ki- 
netics, since the chemical jumps are stochastic and must satisfied the detailed balance 
equation: 

?^^=ex P {-(3[U <7 ,(x,t)-U a (x,t)]} , Va,</ el\ (3.2) 

where (5 is the inverse temperature and, as before, r(a,a'\x,t) denotes the probability rate 
for a jump from a to another state a'. Due to the above considerations, the mechanochem- 
ical evolution of the MM can be described by a PDMP satisfying the detailed balance 
equation (|3.2p . Since there is experimental evidence that some jump rates must depend 
on x, the PDMP is fully-coupled (see [D] and references therein). 

In this section we show how instabilities in the response to external solicitations of MMs 
follow from the multiscale character of the system by means of the averaging principle 
stated in Theorem 12.51 Let us first explain what one means by instabilities (see |J],[VDJ 
for some examples). In ordinary conditions a MM moves typically in a given direction 
along the filament, at a given averaged speed v depending on environmental parameters 
as temperature and ATP concentration. If some external force opposes to the motion, the 
MM slows down and eventually stops at the stall force f s . The observed instability is of 
the following kind: in some range of the values of the environmental parameters the MM 
does not stall, rather for force values close to f s it can proceed in both directions along 
the filament. 

Inspired by |VD| we study this phenomenon by means of a PDMP with three chemical 
states and one dimensional mechanical variable so that the full state is described by 
(x, a) G R x r where T = {0, 1, 2}. For the interpretation of the different chemical states 
we refer to |VD] . we only mention that when a = 1, 2 the MM is attached to the filament 
(but in different ways), while in state a = the MM is detached. The force fields are 
defined as 

\Fq{x) = -x 

= -x-f (3.3) 
-.-(x-l)-f. 

This is the most simple choice to give the mechanical variable an equilibrium position in 
each state. Here / is a control parameter, representing the external force exerted on the 
filament, and therefore on the MM when bound to the filament. These one dimensional 
force fields admit three convex potential functions: 

Uoix) = \x 2 

U x {x) = \x 2 + fx (3.4) 
U 2 (x) = \{x-l) 2 + fx + e 

such that —d x U a (x) = F a {x). Here e is a second control parameter, which can be related 
to the ATP concentration. Finally, the transition rates r(a,a'\x) must satisfy the detailed 
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balance equation (j3.2[) and assumptions (Al) and (A3). There is experimental evidence 
that the jumps between states 1 and 2 are much faster than the other chemical jumps 
and it is reasonable to suppose that the jumps between states 1 and 2 are faster than the 
mechanical evolution (see [Dj, |VD| and references therein). Hence, T can be partitioned 
in two chemical metastates {0} and {1,2}, while the rates r(l,2\x) and r(2,l\x) can be 
rescaled by a factor A. We assume these rates to be positive, thus implying assumption 
(A2') of Section 12.31 Note that the rescaling does not alter the validity of the detailed 
balance equation (j3.2|) . By Theorem 12.51 as A | oo, the coarse-grained PDMP converges 
weakly to a new PDMP with state space M. x {0, *} (0 refers to the metastate {0} and 
* refers to the metastate {1,2}). The force field in the metastate {0} coincides with Fo, 
while in the metastate * is given by F* defined as 

e /3AU(x) x 

where AU(x) = Uz(x)—Ux(x). Note that assumptions (A2') and (A4') are fulfilled. It must 
be noted that while the force fields in (13. 3p have a single equilibrium point, F a (x) = 0, the 
force field F*{x) may have more than one depending on the value of the control parameters 
e, (3 and /. To this aim, we proceed as follows: First we observe that 

F*(x) = F x {x) + - ■ * , (F 2 (x) - F 1 (x)) = -x-f+ ' 



d x F*{x) = -\ + n 7 y:=et 



l + e PAU(x) V^VV - J < 1 + e (3AU(x)- 

Let us take / = 0. Since AU(x) = Uz(x) — U\(x) = —x + 1/2 + e, we obtain 

(i + yf 

Let us analyze the region of positive slope 

/+ = {x £ R : d x F,(x) > 0} = {x : /3y(x) > (1 + y(x)) 2 } . 
Since y > 0, I + = if ^ 4. If f3 > 4, then I + is the finite interval (a_, a+) such that 



y(a±) = 2 ' 

Note that the r.h.s. is always positive. Since y(0) = e^^ +£ \ € i+ if /3 > 4 and 




2^ ) <e< -2 + p l0g [ 2 )■ (3 ' 6) 

In conclusion, if / = 0, /? > 4 and (|3.6|) is satisfied, then d x F*[x) > only in a given 
interval /+ containing the origin, while lim x ^± OQ F*(x) = =poo. Since adding / has the 
only effect to translate the graph of F* along the ordinate axis, we conclude that for a 
suitable value of / the equation F*(x) = has three solutions x_ < < x + and that 



F*(x) < 



> if x < X- , 

< if x- < x < , 

> if < x < x + , 

< if x > x + . 



See Figure [3] below. Now it is simple to check that if the new PDMP starts in the 
mechanical state xq < [xq > 0], then x(t) eventually enters the absorbing interval 
(x_,0) [(0,x + )]. Due to the description of the power stroke mechanism (see |FGR] ) . this 
implies that typically the motor moves towards left in the first case and towards right in 
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the latter. Hence, for suitable parameters e and (3 associated to ATP concentration and 
temperature and for suitable external forces / the MM can move in both directions of 
the filament, depending on the initial configuration of the lever-arm. This behavior is a 
form of instability in the response of the MM. We point out that for the original PDMP 
with three states, there is only one absorbing interval given by (0, 1) which x{t) eventually 
enters a.s. Hence, the instability is related to the ergodicity breaking of the system. 




-1 -0.5 0.5 1 



x 

4. The variational problem (12.241) 

In this section, we briefly analyze the variational problem (|2.24|) . Part of the content of 
Lemma l4.1l b elow is well known, nevertheless we recall its derivation since we need some 
additional developments in order to prove the LDP. 

We call S the subset of [0, oo) w given by the elements c G [0, oo) w satisfying the follow- 
ing irreducibility condition: given a ^ a' in T there exists a finite sequence o~x, o~2, . . . , o~ n 
such that o\ = a, a n = a' and c(o"j,o'j + i) > for all i = l,...,n — 1. We define 
J : [0,oo) w -> R as 

J(c)= sup J{c,z), J{c,z):= Y, c(<7,ff')(l-— )• (4-1) 

*e(0,oo)r (a,a')eW 

Lemma 4.1. The function J is convex and continuous, and takes values in [0, 00). More- 
over, for each c G S, the supremum on (0, oo) r of the function J(c, •) is a maximum and 
the set of maximum points is given by the ray {tz : t > 0}, where z € (0, oo) r is the 
unique solution of the system 

Yc(a,a')^ = J2^'^)—, (4.2) 
a'er Za a'er Z(7 ' 

such that Ylaer = 1- 

Proof. Since J is the supremum of a family of linear functions in c € [0, 00) w parametrized 
by z, J is convex and lower semicontinuous on the set [0, oo) 117 , which is a locally simplicial 
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set (see [R] [Chapter 10]). Hence we can apply Theorem 10.2 in [Rj implying that J 
is upper semicontinuous. This concludes the proof of the continuity of J . Since = 

J(C,1) < J(c) < T,{a,a')eW C ( a ' a ') < °°> We § et that ^( C ) E [0,00). 

Let us now assume that c £ S and prove the conclusion of the Lemma. We can write 
J{ c ) = [T,(a,*')ew c ( a > a ')] ~ inf ^G(o,oo)r $(z), where 

$(*):= ^ c(a,a')^, zG(0,oo) r . (4.3) 

Hence it is enough to prove the analogous statements for the infimum of Since $(z) = 
&(jz), for all 7 > 0, in order to study its infimum we can restrict $ to the set A := {z £ 
(0, oo) r : X^o-er z ct = !}• Trivially $ is a positive function. Let z^ ra ^ £ .4 be a minimizing 
sequence for <E>, i.e. a sequence such that 

lim $(z (n) ) = inf $(*). 

n-^co zG(0,oo) r 

Due to the fact that A is relatively compact in M r , at cost to take a subsequence, we can 
assume that z^ is convergent. Let us first suppose that z = liu^^oo is such that 
there exists some a £ T with z CT = 0. Then necessarily also z a > = for any a' such that 
c(a,a') > 0. In fact, otherwise, we would have: 

(n) 

$(zW)^ C ( C T,O f fe™+0O. 
Za 

Iterating this argument and using the fact that c £ 5, we deduce that necessarily z = 
but this is incompatible with the fact that z belongs to the closure of A. Therefore, it 
must be z £ A. Since the function <3? is continuous on A, we conclude that 

inf $(z) = lim $(z (n) ) = $(z) , 

zG(0,oo) r n-*oo 

and the infimum is a minimum. Since z is a minimum point for the C°° function $ on 
(0, oo) r , it must be V3>(3) = . As follows from the computations below, this identity 
coincides with the system of equations ()4.2p . Finally, we prove that such a system has a 
unique solution on A. Indeed, straightforward computations give that 

E (c(<T,a)—-c(a,a)^ 



g^W = 2^ 2c(^);s > 

1 1 

-(z) = -c(<7,<r) -j -c((t,ct)-2- , cr^a. 



oz-oz^ zi z~ 



a 



Setting 

the above computations imply for each z £ (0, oo) r that 



c(a,a\z) 



E E wtttt-c*) = - 2 E E > ° e Rr • ( 4 - 4 ) 
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On the other hand, from the system of identities (14. 2|) . it is simple to derive that, whenever 
V$(z) = 0, it holds 

^ ^c^lz)^-^) 2 = -2 J^Ma,^)^, b€R r . (4.5) 

Setting b a = a a /z a in (14. 5p and comparing the resulting identity with (|4.4|) . we obtain 
that 

ES^k^m - £I>.3W(§ - t;) 2 (") 

<T <7 ' C (J 

if V3>(z) = 0. Hence, this last condition implies that the r.h.s. of (|4.6|) is zero if and only 
is a a /z a = a^/z^ whenever c(a,a) > 0. Due to the fact that c € S, this implies that the 
vector a is proportional to z. We observe that the tangent space in z to A, i.e. T Z A, is 
given by the R r -vectors orthogonal to z. Hence, if z E A satisfies V<$(z) = then the 
map (<3? restricted to A) has strictly positive defined Hessian in z, thus implying that 
z is a strict local minimum. On the other side, if z € A is an extremal point of then 
V$(z) is orthogonal to the tangent space T z «4, which is given by all vectors orthogonal to 
z. But, since &(tz) = &(z) for all t > 0, by differentiating this equality in t = 1 we obtain 
that V<&(z) ■ z = 0. In conclusion: the set of extremal points of <3?|^ coincides with the set 
{z £ A : V$(z) = 0} and we know that all these points are strict local minima of 
Hence, there can be at most one local minimum point. □ 

We note that, given c € S, there exists a small ball B in M> w centered in c such that 
B n [0,oo) w C S. Hence, we think of <S as a manifold of dimension \W\ with boundary, 
embedded in W w . Given c £ 5, we write z(c) for the unique point of maximum of J(c, •) 
in A described in the above lemma. Then, the map z(c) is regular: 

Lemma 4.2. The function z : S — > A is C 1 , i.e. there exists a C 1 function g : U — > A 
from an open subset IA C R w containing S, whose restriction to S coincides with z. 

Proof. Let us first consider the smooth function G : M> w x A — > K r defined as 

G(c,z)a- = ^ { C ( a 'i a )/ Z a' ~ c(0-,0-')z a ,/zl) . 

Let us fix c G S and write z for z(c). Due to the computations in the proof of Lemma 
14.11 G(c,z) = V z^{z) for each z E (0,oo) r , the function being defined in (|4.3p . In 
particular, G(c,z) = 0. Moreover, we know that the tangent map T z G(c, •) from T^^4 to 
M r is a linear monomorphism for z = z, since the Hessian of $|_4 in z is strictly positive. 
We call Vz the image of T Z A by the tangent map TjG(c, •). Then has dimension 
k — 1 = |r| — 1 as TzA. In particular, there exists a € T such that 7T3f(Wj) has dimension 
re— 1, where 71"^ is the canonical orthogonal projection tt^ : M r — > M r ^°"^. This implies that 
the smooth composed map H : R w x A -> defined as "ff = vr ? o G has isomorphic 

tangent map l~H~(c, ■) from r 5 «4 to R r \M. Hence we can apply the Implicit Function 
Theorem for differential manifolds and conclude the following: there exist a neighborhood 
U of c in R^ 7 , a neighborhood V of z in „4 and a C 1 map f : U —>■ V such that i) 
H{c\f(c')) = for all c' <E U and ii) if H(c',z) = for some c' <E U and zeV then 
z = /(c'). At this point, we only need to prove that G(c' , f(c')) = for all d 6 U in 
order to conclude that z(c') = /(c'). If H(c / , z) = then G{d ', z) CT = for all <r G T \ {5}. 
On the other hand, for all (c',z) eM ff x (0,oo) r it holds z a G{d , z) a = 0. Hence, if 
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H(c', z) = 0, it must be 

G(c', z)z = z~ l z a G(c',z) a = 0, 

thus concluding the proof. □ 

We give now another technical result which will be useful for the proof in Appendix iBl 

Lemma 4.3. Fix c £ [0, oo) M/ . Then, J{c) = if and only if 

J>(a,0=£c(a». (4.7) 
o-'er o-'er 

Proof. Let us first prove the claim for c € S. If (14. 7p is verified, then it is trivial to 
check that z S (0, oo) r such that z a = l/y^jr| satisfies (I4.2p . and therefore it is its unique 
normalized solution. Then, by direct computation, J(c) = J(c, z) = 0. If (|4.7p is not 
verified, then the above z is not a solution of (|4.2p . This implies that J{c) > J(c, z). But 
trivially J{c, z) = 0, thus implying that J{c) > 0. 

We now extend the result to general c G [0,oo) w . To this aim define c* € [0,00)^ 
setting c*(<7, o - ') = 1. Trivially, c* belongs to 5 and satisfies ()4.7p . Suppose first that 
c satisfies ()4.7p . Then each vector Ac + (1 — A)c* with A G [0,1) satisfies ()4.7p . and 
moreover belongs to 5 having only positive entries. By the first part, we conclude that 
J{\c + (1 — A)c*) = for all A € [0, 1). Due to the continuity of J (see Lemma |4TT|) we 
conclude that J(c) = 0. Let us now suppose that c does not fulfill (|4.7|) and prove that 
J{c) > 0. By convexity of J (see Lemma |4~T]) . for each A € [0, 1] it holds 

J(Xc + (1 - A)c) ^ A J(c) + (1 - A)J(c*) = AJ(c) . (4.8) 

On the other hand, all vectors Ac+ (1 — A)c* with A € [0, 1) belong to S and do not satisfy 
(|4TT1) . Due to the first part, taking A = 1/2 we conclude that J(l/2(c + c*)) > 0. This 
together with (fj~8|) implies that .7(c) > 0. □ 



Let us now come back to the variational problem (|2.24p and derive some results about 
it from the previous observations. 

Given a nonnegative measure tt on T and nonnegative numbers r(o~, a'), (cr,a') € W, 
we define c[7r,r] € [0, oo) w as 

c[tt, r] (a, 0-'):= n(a)r(a, a') , V(<r, (r')eW. (4.9) 

Then (recall (|2T24l and (14711) ) 

i(vr,r) = j(c[TT,r}) 

and the previous results on the variational problem associated to J give information on the 
variational problem associated to j. In particular, we stress that due to (|4.9p the system 
of identities (|4.2p coincides with the stationarity of the measure ir w.r.t. the Markov 
generator R(-, - \z) on V defined as 

Recall the definition of the function z : S — > A. Given a nonnegative measure tt on T and 
(x,s) eR d x [0,T], we define 

z(tt, x, s) := ?(c[-7r, r(-, -\x, s)~\ ) (4-10) 



R(cr, a'\z) 
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if c[tt, r(-, '\x, s)l belongs to S. 

Let us now take a strictly positive measure it on T, i.e. vr(<r) > for all a G T. Then, 
by Assumption (A2) c[tt, r(-, s)] belongs to S. If the quasistationary measure //(-|x, s) 
is reversible for the chemical generator L c (x,s) with jump rates r(a,a'\x,s), then the 
solution z G .4 of the system (|4.2[) with c = c[~7r,r(-, -|x,s)] can be computed explicitly. 
Indeed, setting 

z a = zJ *W , aer (4.ii) 

y n{a\x,s) 

(where Z is the normalizing constant assuring that z £ A), one has the detailed balance 
equation 

z i z 
n(a)r(a, a'\x, a)-£- = ir(a')r(cr' , a\x, s)=— , (4-12) 

and consequently the validity of (|4.2|) , Due to Lemma 14.11 we conclude that 

j(ir,r(-,-\x,s)) = j(c[ir,r(-,-\x,s)],z) = 



If 7T is not strictly positive, we can take a sequence 7r n of strictly positive measure on T 
such that 7r n (o") — > vr(o") for each <t S V. This implies that 

c[vr n ,r(-,-|x,s)] -> c[vr, r(-, s)] . 

Since, as proved in Lemma 14.11 J" is continuous on [0, oo) w , we obtain that 

j(vr n ,r(-, -|a;,s)) = J"fc[7T n ,r(-, -|a;,s)]) J^cfvr, r(-, s)] ^ = i(vr, r(-, s)) . 

The above limit allows to extend (|4.13|) also to the case of general ir G [0, oo) r with the 
convention to set ir(a)r(a, cr'\x, s)( 1 — J -^7^4 equal to zero if 7r(cr) = 0. 



tt (cr) fj,(cr' \x,s) 

This facts imply at once (|2.2T|> assuming (I2.26D 

5. Proof of Theorem 12.21 

Our proof of the law of large numbers in the time interval [0, T] is based on a two scales 
argument. We give some comments on our strategy for what concerns the mechanical 
evolution, similar arguments hold for the chemical one. We first divide the interval [0, T] 
in M subintervals I k = [kS, (k + 1)6], 5 := T/M, k G {0, 1, . . . , M - 1}. We denote by 
Pxat t ne l aw °f the PDMP starting at (x, a) at time t with A-accelerated chemical jumps, 
and by x*(-\x,t) the solution of the Cauchy system 

U(s) = F(z(s),s) , Ot, 
1 z(t) = X . 

We recall that P '£ CTo = Px ,a - Then we prove that given j3 G (0, 1) there exists M = 
M{(3) such that for each k G {0, 1, . . . , M — 1} the following holds: starting at time kd in 
an arbitrary state (x',a r ) the random mechanical trajectory (x(t) : t G Ik) deviates from 
(x*(t\x', kd) : t G Ik) typically less than (55. This is the content of Lemma 15.11 below. 
Having this result we can derive (12.190 of Theorem 12.21 as follows: in order to compare the 
mechanical trajectory (x(t) : t G [0, T]) with (x*(t\xo,0) : t G [0, T]) (x(t) being now the 
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random mechanical trajectory when starting at state (xq,cto) at time zero) we fix (3 > 0, 
take M = M{(3) as above and by means of Lemma 15. II for each k € {0, 1, . . . ,M — 1} we 
compare x(-) restricted to the time interval I k with the path (x*(t\x(k5), k5) : t € As 
second step, we compare this last path with (x*{t\xQ,0) : t € Ik). Due to the Lipschitz 
property of the force fields, we will show below that 

sup \x*(t\x(k5), kS) — x*(t\xo, 0)| ^ 

C\x*(k5\x(k5),k5) - x # {k5\x , 0)| = C\x{kS) - x*(k6\x , 0)| . (5.2) 

This bound allows to implement by a recursive procedure all the above estimates going 
from one 5-subinterval to the next one. 

In addition to 5, another scale plays a crucial role. Indeed, in order to prove Lemma 
15.11 we first divide each time interval I k = [k5, (k + 1)5] in N subintervals {Ik, n }o ^n<N, 
where ij. n = [kd + ne, k5 + (n + l)e] and e := 5/N. Then we prove that the PDMP on I k , n 
obtained from the original one by freezing the chemical jump rates at time kS + ne has a 
not too large entropy w.r.t. to the original PDPM on Ik, n - This entropy estimate allows 
to bound the probability for a deviation of order at least /3e of the mechanical trajectory 
on Ik t n from the expected asymptotic one. 

Let us now enter into the technical details of the proof: 



Lemma 5.1. Fix a constant (3 G (0,1), a continuous function f : [0,T] — > R and a 
compact set K, C R rf . Then there exists a positive integer M such that for all o~Q,a E T, 
for all k E {0,1, ... ,M — 1}, setting 5 = T/M it holds 



lim sup P* o kS sup \x(t) - x*(t\x , kS)\ ^ (35 = , 

^t°°x G/C V kS < t < kS+S I 



lim sup P a A 



kS+S 



fit) ix(o-(t) = a) - fj,(a\x*(t\x ,k5) , t)] dt 



hi) 



> (35 



(5.3) 
0. 

(5.4) 



Before proving the above lemma, let us explain how to derive from it Theorem! 

Proof of Theorem El 

Let us prove (|2.19[) . We start with some general consideration. As proved in Lemma 
IC.ll there exists a compact K! such that x(t) £ Kl for all t G [0, T], P A (T0 -a.s. and 
for all A > 0. By the same lemma, there exists a compact /C containing Kl such that 
x*(t\x',s) S K, for all x' G JC' and s < t in [0, T\. We take the positive constant K as 
in (|2.7p for /C as described above, and by taking K large enough we assume that (12. 7p is 
satisfied also by the averaged field F. Then, we take M as in Lemma [5. II (since we are now 
only interested in proving (|2.19p , we can fix the function / in Lemma 15.11 arbitrarily) . We 
divide the interval [0, T] in M subintervals 1^ = [kS, (k + 1)5], where k = 0, 1, . . . , M — 1 
and 5 = T/M. For each k, we define 

A fe := sup|x(t) - a;*(i|x , 0)| , 
tei k 

A k :={\x{t) -x*(t\x{k5),k5)\ <(35 Vie I k }. 
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Due to Lemma 15. II and the Markov property of PDMPs, we have that 

P^Mk)= E k^ P im{ A kH^),a{k8))} < sup P^ kS (A c k )^0. (5.5) 



This implies that 



AJoo 



o, 



A 



n 



M-l 
k=0 



A k 



(5.6) 



Assuming the event Dj =0 Aj to be verified, since x*(t|xo,0) = x*(t\x*(k5\xo, 0), k5) and 
applying Gronwall inequality as in Lemma IC. 11 we obtain that 

Afc ^ suplx(t) — x*(t\x(k5), kS)\ + sup\x :¥ (t\x(k5), k5) — x*(t|xo, 0)1 



tei k 



tel k 



< (35 + e KS \x(k5) - x*(k5\x ,0)\ < (35 + e Kd A k ^. (5.7) 



KS 



Due to the event Pij =0 Aj, we can iterate the above procedure and conclude that Afc_i < 
(35 + e KS A k _2 and so on. At the end we obtain that the event D^ =0 Aj implies the event 

B k := { A < (36 and Aj < (35 + e KS A j ^ 1 Vj = 1, 2, . . . , k} . 

Setting z = e K6 , it is simple to check by induction that the event B k implies that for each 
j = 0, 1, . . . , k it holds 



Aj < (35{l + z + z 2 + --- + z j ) ^(35- 



1 



(38- 



1 



^(3(e 



KT 



1)/K (5. 



z-1 ' e Kd -l 

(in the last inequality we have used that e x — 1 ^ x for any x ^ 0). Hence, .4, implies ()5.8p 
for all j = 0, 1, . . . , M — 1 and therefore it implies that 

(5.9) 



sup \x(t) — x*(t\x , 0)| ^ (3(> 



KT 



Due to arbitrariness of (3, this implies (j2. 19|) . 



l)/K. 



Let us now prove (|2.18p . We take M as in Lemma |5.1[ where / is the same function 
appearing in Theorem 12.21 and K, is defined as above. Using the same arguments as above, 
it is simple to derive from Lemma [5. II that P^ ao (C) = 1 — o(l), where C denotes the event 



C 



pkS+S 
^ JkS 



f(t) X (<r(t) = (r) - fJL(a\x*(t\x(k5),k6),t) 



dt ^(35, 

Vfce{o,i,...,M-i}}. 

By assumption (A3) we know that there exists a constant k > such that (|2.12p holds for 
all x, y £ K, and for all t € [0, T]. Hence, we can estimate 



kS+5 



kS 



f(t) ii(a | x*(t\x(k5), k5) , t) — /i(cr | x*(t\x , 0) , t) 



dt 



K \\f\\oo5 sup\x*(t\x(k5), k5) — x*{t\xo, 0)| . (5.10) 

Trivially, 

|x*(£|:c(fc<5), k5) — x*(t\xo, 0)| ^ \x*(t\x(k5), k5) — x{t)\ + \x(t) — x*(t\xo, 0)| . 

If A is verified, the first addendum in the r.h.s. is bounded by (35 (recall that A implies 
Ak), while the second addendum is bounded by A k ^ (3(e KT — l)/K. Therefore, we can 
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conclude that whenever the event A is verified the r.h.s. of (|5.10p is bounded from above 
by 

K\\f\\ 00 6([35 + P(e KT -1)/K). 
Using the triangular inequality, we conclude that the event A DC implies that 

l-T 



/CO X(<7(0 =cr ) - li(cr\x if (t\xo,ti), tj 



dt 



Mj35 + M«||/||oo<5 {135 + (3(e KT - l)/K) = 

T(3[l + «||/||oo(<y + (e KT - l)/K)] = C(T, K, n, f)[3 . (5.11) 



Due to the arbitrariness of (5 and since P% (AnC) = 1 — o(l), the above estimate implies 



(I2.18P . This concludes the proof of the averaging principle stated in Theorem 12.21 □ 

We can now concentrate on the core of the law of large numbers, given by Lemma [5. II 

Proof of Lemma 15.11 We stress that j5 has to be considered as a fixed constant. We 
will play with two length scales: 5 and e, defined below. C, c', c, q, . . . will denote non 
random positive constants independent from 5 and e, that can change from line to line and 
that can depend on (5. For simplicity of notation we take k = (the arguments remain 
valid in the general case). As the reader can check, in order to prove Lemma 15. II we will 
consider the process only when the mechanical trajectory x(t) lies inside a given compact 
set (uniformly in the starting point xq G /C). Hence, at cost to take a larger Lipschitz 
constant K in ([221), we can assume ([277|) . (pTiOj) . (l2"7L2j) and (f2TT]) to hold for all x, y G R d 
with k = K. This allows to much simplify the notation. 

We first prove (|5.3p and explain how to choose M. To this aim we observe that due 
to Lemma |C . 1 1 there exists a compact subset K C M. d such that x*(t\xo,0) G K, for each 
t G [0, T] and xq G IC. We define the compact set K! as 

JC' :=\J xeZ B(x,T), (5.12) 

where B(x,T) denotes the closed ball centered at x with radius T. Given a pair (x,t) G 
)C' x [0, T] we consider the continuous-time homogeneous Markov chain on T with transition 
rates r(a,a') := r(a,a'\x,t), a ^ a'. Note that this Markov chain is ergodic and has 
fj,(-\x,t) as stationary probability. We call Qa,x,t its 1 &W when starting in the state a. We 
will use the following uniform large deviation estimate 



lim sup sup 

u^oo ( x ,t)eK'x[0,T\,(r,<T'£T 



— hxQv' x t 

u 



1 



[x(*( 



n(a\x, t)] ds 



(3 



20(a» + l)|r| 



where 



max max max \F„t(x', s)\ 
CT'er se[o,T] x'eK' 



-W!<0, (5.13) 



(5.14) 



and W\ is a strictly positive constant. The result (|5,13p follows from lemma [B.ll in Ap- 
pendix [Bj 

We now introduce a second positive constant W% defined as 



Wo 



K + 2 + a* 



(5.15) 
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Finally we define the constant 5 := T/M, where M is the smallest positive integer such 
that 

5 ^ min{Ty 1 /(4c 3 ), 2p/(5W 2 )} , (5.16) 
where the positive constant C3 depends only on the compact /C and will be defined in 

dSMD - 

Let us now prove (|5.3p for k = 0. In order to shorten the notation we write x*(i) 
instead x*(i|xo,0). We stress that x*(i) depends on xo, although xo has been omitted in 
the notation. We define the random time r in terms of the exit time from the /3<5-tube 
Aps around x*(i): 

t :=mf{t > : (x(t), t) g" Aps} , 

where 

Aps ■= {(x,t) G R d x [0,5] : |x-x*(i)| ^ 05} . (5.17) 

Note that, since (36 ^ T, for each xo G /C the above tube A.^5 is included in /C. We want 
to prove that r ^ 6 with probability 1 — o(l) as A | 00, which is equivalent to (|5.3p . Up 
to the Markov time r the PDMP is determined only by its characteristics restricted to 
Aps- Since we will follow the process only up to time r, due to (|2.7p and (|2.10p . at cost 
of changing the characteristics outside Aps without loss of generality we can assume that 

\F a (x,t) - F„(x*(t),t)\ ^K6, (5.18) 

\r(a,a'\x,t) - r(a,a'\x*(t),t)\ < K5 , (5.19) 

\la(x,t) - 7(T (x,(t),t)| <A-<J, (5.20) 

for all x G R d and i G [0,(5]. Using (|5.18|) and the fact that r ^ <5, one easily obtains that, 
given m = 1, 2, . . . d, P£ CT0 -a.s. it holds 

x(t) m = x(0) m + / F a{s) (x(s),s) ds 

Jo 

= x(0) m + / F a{s) (x*(s),s)ds + £ 1 , Vt<r, (5.21) 
Jo 

where the error term £\ can be bounded as \E\\ ^ K5 2 . 

Given an integer N, we divide the interval [0,(5] in N subintervals of length e := 6/N. 
We now explain how to fix the constant e. The first requirement is that e ^ <5 2 . Moreover, 
consider the functions F c (•, •) on Kl x [0, T]. Since they are uniformly continuous, there 
exists e\ > such that \F a (xi, s±) — F a (x2, S2) | ^ S for any x±,X2 G /C', si, s 2 G [0, T] such 
that \x\ — x 2 \ ^ £i and |si — S2 1 ^ £%■ We require that 

e < min{ei,ei/C7 } , 

where 

Co = sup |F(x,s)|, F(x, s) = y~] F a (x, s)[i(a\x, s) . 
Or,s)e/C'x[o,T] CTGr 

We note that this condition implies that 

\F(j (x* (5) , s)/72 Fq-^x^ (t),t) m \^S (5.22) 

for all m = 1, . . . d, all a G T and all s, i, G [0, T] such that |s — i| ^ £• Indeed, for such s, t 
it holds 

|x*(s) — x*(i)| = I / F(x*(u),u)du\ < C7q|s — £| < ei . 
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This allows to derive (15.220 from our choice of e\. By similar arguments we derive that 
for a suitable positive constant £2 it holds 



\r(a, a'\x*(s), s) — r(a, a'\x*(t), t)\ ^ 5 



(5.23) 



for any s,t, G [0,T] such that \s — t\ ^ £2 and for any a 7^ a' in T. We fix e s.t. e ^ £2- 
Similarly, there exists a positive constant £3 such that 



\/j,(a\x*(s),s) — n(a\x*(t),t)\ < 







20(o» + l)|r| 

for any s, t, € [0, T] such that |s — 1\ ^ £3 and for any a in T. We fix £ s.t. £ sj £3. 



(5.24) 



Writing 



Jo 



.X* s , s 



ds = y2 F a (x*(s), s) m x(cr(s) = a)ds , 
aer Jo 



due to (l5~2ll . (I5~22l) and the condition £ < J 2 , it holds 

L*/eJ-l 



x(i) T 



= a)ds+£ 2 , Vt^r, (5.25) 



where the error term £2 can be bounded as j^l ^ \ + <5 2 + <5 2 a*. Above, |_i /ej denotes 
the integer part oit/£ and the sum over j is set equal to zero if \t/e\ = 0. The condition 
£ ^ 5 2 is necessary in order to bound the error term Jjt/eje J ^o'(s)( a:; *( s )' s) m ds. 

We claim that there exist positive constants c, c' independent of £ and <5 such that the 
A-accelerated PDMP with unrescaled characteristics satisfying (|5.18p . (|5.19p and (|5.20p 
fulfills the bound 

rje+e 

[x(c(s) = a) — n(cr\x*(s\xo,Q),s)]ds > ttt, — — ^ — 1 



pA 



10(0* + i)|r| 



-cXe 



(5.26) 

for any j = 1, 2, . . . , N — 1, any xo £ /C, any x' G M rf s.t. |x' — x*(j£|xo, 0)| ^ /3S, for any 
a, a' G r and for any A ^ c'/e. We recall that a* has been defined in (|5.14|) . Above we 
used again the notation x*(-|xo,0) in order to stress the dependence on xq. 

Before proving (|5.26p let us explain how it allows to conclude the proof of Lemma 15.11 
First we show that, due to (|5.25p . (|5.26p and the Markov property, with probability at 
least 1 - (<5/£)e- cAe |r| it holds 



x(t) r 



L^J- 1 ne+e 
(0)m + ^ ^2 F a (x*(j£),j£) m (J,(<r\x*(s), s)ds + £3 , Vt ^ T . 



fje+e 
'3* 



(5-27) 

where the modulus of the error £3 can be bounded as \£s\ ^ (£2! + (35/10. To this aim, we 
define the event Bj(cr) for j = 0, 1, . . . , N — 1 as Bj{a) := Cj{a) n {j£ + £ ^ t} where 



Cj{a) 



JE + E 



= o") - fi((r\x^(s),s)]ds 



> 



f3£ 



10(a* + i)|r| 



(5.28) 



Conditioning on time je and using the Markov property we can estimate 
Pi,a (Bj(a)) = P^iCjia) ;je + £ ^T) = E^ aQ [P x{je)Hje) , j£ {Cj{a))x{3£ + e < r)] . 
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At this point, we observe that the condition je r implies that \x(je) — x*{je)\ ^ 06, 
thus allowing to estimate the probability P x (je),a(je),je{Cj{o')) from above by e~ cXe due to 
(|5.26p . In particular, we obtain that 

P^ (B) < iV|r|e- cA£ , B := U ffGr uf^ 1 B 3 (a) . 

Finally, we note that the event B c implies for any a that Cj(a) is not fulfilled whenever 
the interval \je,je + s] is included in [0, r]. Hence, in this case in (|5.25|) one can substitute 
x(o"(s) = a) by /j,(a\x*(s), s) with an error bounded by 0eN/lO = 06/10. This leads to 

By applying again (|5.22p , (|5.27|) implies that 

x{t) m = x(0) m + / F a (x*(s),s) m fi(a\x*(s),s)ds + £4 = x*(t) m + £4 , Vi < r , 

(5.29) 

where the error £4 can be bounded as {£4] ^ | £"3 1 + <5 2 . Collecting all the previous estimates, 
we conclude that for all xq € K, it holds (£4! ^ 06/10 + W26 2 , the constant W2 being 
defined in (I5,15p , Hence, due to our choice (|5.16p . we can conclude that | £"4 1 ^ 06/2. 
Hence, taking t = r in (|5.29j) . we conclude that with probability 1 — (5/s)e~ cXe \T\ it 
must be \x(t) — x*(r)\ ^ 06/2. Due to the continuity of the mechanical trajectories and 
the definition of r, this implies that r = 5. Coming back to (|5,29p with this additional 
information we get (|5.3p with k = 0. As already remarked, the same arguments allow to 
prove (15. 3p for a generic k. 

We point out that by the above method we have approximated the random integral 

kS+S 

F a (x(s),s) m x(cr(s) = a)ds 

8 

by the new integral 

fc<5+<5 

F<r(x*(s), s) m /i(a|x*(s), s)ds . 

s 

Hence, the proof of (|5.4j) is completely analogous, since it is enough to replace the force 
field with the test function f(s). 

It remains now to prove (|5.26p . In order to simplify the notation, we write P x for 
the law P x , a , j £ of the A-accelerated PDMP having unrescaled characteristics that satisfy 
(I5,18p . (|5.19p and ()5.20p . starting in the state (x',a') at time je and evolving up to time 
je + e. In addition, we write Q x for the law of the A-accelerated PDMP restricted to the 
time interval \je,je + e], starting in the state (x',a') at time je and with characteristics 
(i 7 , Ar) , where the new unrescaled transition rates r are constant and are defined as 

r (0-1,0-2) :=p(cri, 0-2)70-1 , 
p(ax,a 2 ) ■-p(ai,a 2 \x*(Je),je), 
la ■= j <7 (x*{je),je) . 

Namely, the above rates correspond to the original rates read along the asymptotic trajec- 
tory and frozen at time je. Note that this new PDMP is not coupled: the chemical evo- 
lution is a continuous-time homegeneous Markov chain, while the mechanical evolution is a 
function of the chemical one. One can compute and bound the Radon-Nikodym derivative 



A- 
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dP x /dQ x . Indeed, if (x(t), a(t)) is an element in the Skohorod space D([js, je + e],R d x r) 
with n jumps at times T\ < T2 < • ■ ■ < r n , setting tq = je, o"o := cr', xq := x' and 



Oi := a(Ti) , Xi := x(t { ) , i = 1, 2, . . . , n . 



one has 
dP x 



dQ , MO,*)) 



n 

i=l 



r(o-i_i,o-t|x(ri),Ti) 
r(f7j_i 5 (Ti) 



exp 



A / ( 7<r(s) s ) - 7ff(s)) ds f • ( 5 - 3 °) 



The term in the square bracket can be rewritten as 

n r(ai-i,ai\x(Ti),Ti) JA n , \ i \ \ \ ~t w 
— r = exp \ y [lnr(ai-i,ai\x{Ti),Ti) - lnr{a i - 1 ,a i )\ 



(5.31) 



. i=l 



Due to (|2.10p . (|5.23p and the assumption e ^ £2 we conclude that 

I r((Ti_i,crj|a;(ri),ri) - r(crj_i, <Tj) | = [ rfa-i, cri\x(Ti), n) - r(a i - 1 , ai\x*(je), je) \ 

< \r(<7i-l,(Ti\x(Ti),Ti) ~ r(<Ti-l,<Ti\x*(Ti),Ti) \ 

+ I r(a i ^ l: a i \x :¥ (Ti),Ti) - r{a i -. 1 ,Gi\x lf {je), je) | ^ (K + 1)5 . 

By applying Taylor expansion to the log function and using (|5.3ip . we get that the 
term in the square bracket in (|5,30p is bounded from above by e c ° n<5 where n denotes the 
number of chemical jumps in the interval [je,je + e]. The constant Co does not depend 
on 0,e,6,j and is the same for all xo € /C and all pairs (x',a') as in (|5.26p . Similarly one 
gets that the exponential in (|5.30p is bounded from above by e ClXeS , where the constant 
ci does not depend on (3,e,5,j and is the same for all xo G fC and all pairs (x',a') as in 
(I5.26p . Moreover, setting 

C : = max max "faix, s) , 
o-er (x,s)&K'x[o,T] 

the random variable n is stochastically dominated by a Poisson random variable Z with 
mean CXe. Recalling that E(e aZ ) = e c ' Ae ( e<1 - 1 ) an d taking a = 2cq<5, we conclude that 



dP> 



dQ> 



< e 2ciAe5+CA£(e 2c o*-l) < &C3 



\e8 



c 3 := 2ci + 2c C 



e T -l 



(5.32) 



Above we have used the inequality e a 
from the convexity of x — > e x . 



1 ^ 



e 1 -! 



x valid for all x E [0, T], which follows 



Due to (|5.24p and our assumption e ^ £3 we can bound 

fje+e 

\n{<j\x*{s),s) - /x(o-|x*(je), ds ^ 



(3e 



Hence, calling T> the event 

fj£+£ 



20(a* 



V r- 



[x(c(s) = cr) - Mo-Mje), je)]ds 



> 



1 r 



/3e 



20(a* + l)|r| 



in order to conclude the proof of (|5.26p we need to bound P X {T>). To this aim, we write 
Q a i for the law of the continuous-time Markov chain on V starting at a', jumping from 
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u\ to o"2 with transition rate r{p\,02). Note that fi(-\x*(je),je) is the invariant measure 
for this Markov chain. Then 

fAe 



Q X [V] = Q a > 



1 



> 



(5.33) 



20(a* + l)|T| 

We note that x' as in (|5.26p must belong to the compact set K! . Hence, due to (|5.13p . if 
\e ^ C4 (en being independent on e, 5 and being the same for all (x\ a') E Kl X T), then 

Q x [V] ^ e' eXm / 2 , (5.34) 

where W\ has been defined in (15. 131) . 

Finally, we can apply Schwarz inequality together with (|5.32[) and (|5.34|) in order to 
conclude that 

' dP^ \ 2i 1/2 r 1 

V " Q x {Vfl 2 < exp[-A£[T^i/4-c 3 <5/2]}. 



P X [V] = E, 



Q 



dP x 

W' xv - 



(5.35) 

Since by definition (l5~16l) c 3 5/2 ^ Wi/8, we obtain that P X [V) sC e - AeW V 8 . This implies 
(jOSD with c = Wi/8 and c' = c 4 . 

□ 

6. Proof of Theorem 12.31 

We have now all the tools in order to prove the LDP. We recall that in Section d] we 
proved (|2.27|) assuming (|2.26|) . Here we start by analyzing the Radon-Nikodym derivative 
of the PDMP w.r.t. a perturbed version. To this aim let V = {Kr} CTg r ^ e a f amu y 

of C 1 functions V a : [0,T] — > R parameterized by a G T and call V^(s) := the 
corresponding derivatives. We introduce some perturbed rates according to the following 
definitions 



r(a,a'\x,s) := r(a, a'\x, s)e v °' ^~ v ^ 
j a (x,s) := ^2 r{a,a'\x,s) . 



(6.1) 



o-'er 



Writing Px^a for the law of the PDMP with characteristics (F, Ar) and denoting by 
r i < T 2 < ■ ■ ■ < T n the jump times of the path cr(-) in the time interval [0, T], it holds 



dP 



p[x,<r) = exp \ Y.lV^in) - V <Ti) {n)\ 



X ,<T 



. i=l 



exp | -A £ r(a(s),a'\x(s),s)(l - e ^'W- W fl ))d s j . (6.2) 



In order to estimate the first exponential in (|6.2|) we observe that 

■_n ■/ T, ■ n 



2 = '« 1=0 

where we set tq := and T n+ \ := T. This implies that 



ex p|D^-)^)-^)^)]} =ex p{" V «(T-)(T) -V a{0) (0) - £ V' {s) (s)ds | 
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Writing Qx'^a for the law of the perturbed process on T the above computations give 



-^fl( x ,p)=e W {-\[Mx, P )+0(l/\)]} , 



(6.3) 



where 

j v ( XiP ) = Y^Y, [ p{s)*r{a,a'\x(s),s)(l-e v «'^~ v °^)ds (6.4) 

and 0(1/ X) denotes a quantity bounded in modulus by c/A, c being a positive constant 
depending only on {V a } a€ r and T. 

We point out that the function Jy : T — > R is continuous. Indeed, if (x^ n \ p^) 
converges to (x, p) then 

Jv(x<- n \pW)-Mx, P ) < 

EE / T W n) (s)-p ff (s))r(tr )( 7'W S ), S )(l-e^'( s )-^( s ))d S 



+ 



r(a,o-'|x(s),s) - r(CT,cr'|x (n) (s),s) da. (6.5) 



Since pi"^ — > /O^ in J[0, T] and since the transition rates are continuous, the first expression 
in the r.h.s. goes to zero as n — > oo. Since \\x^ n ' — x\\oo — * 0, by the continuity of the 
transition rates and the Dominated Convergence Theorem the second expression in the 
r.h.s. goes to zero, thus concluding the proof of the continuity of Jy. 

Consider the function J(x,p) defined in (|2.26|) . This can be rewritten as 



J(x,p) = SUp V V / p (j 



(s)r(a, a'\x(s),s) 



1 



ds . 



(6.6) 



where the supremum is taken over the family of measurable functions {z a } aG r, z a ■ [0, T] — > 
(0, oo). Approximating measurable functions by bounded C 1 functions, we obtain that the 
functional J(x, p) defined in (|2.26|) can be expressed as 

J(x,p) = sup Jy (x, p) , (x,p)ET. (6.7) 
V 

• Regularity of J. Trivially J{x,p) < oo for each (x,p) € T. Moreover, J is lower semi- 
continuous since due to the previous observations it is the supremum of the family of 
continuous functions Jy. 

• Proof of the upper bound 112.28]) . Let us start with a generic subset U C T. Given a 
family V of C 1 functions {V a (s)} a ^r, we can bound 



QL« n (U) = Q: 



This implies that 



^fi Xu \ < e -Ainf ( ,„ )e akv(^)+0(A-)] Q A,V o([/) ^ 

-Ainf (:EiP)e ( 7 [jv(x,p)+0(A- 1 )] 



limsup T logQ^ (J7)< - inf J v (x,p). 
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This holds for any choice of the functions V a . Optimizing over the V a we get 

limsup-logQ* (£/) < -sup inf J v (x,p). (6.8) 

A^oo A V (x,p)eU 

At this point, we would like to invert the supremum and the infimum in the r.h.s. if U is 
given by some closed subset C C T. To this aim we observe that (i) C is compact since it 
is a closed subset of the compact space T (see Lemma [A. 2p . (ii) estimate (|6.8p holds for 
each U C T and in particular for each open subset U C T, (iii) Jy(x,p) is continuous on 
T for each V G C^O^f. Hence, we can apply Lemma 3.3 in |KL] (note that Jp{p) there 
coincides with our —Jy(x,p)), which together with (|6.7f) implies the upper bound 

limsup (C) < - inf sup Jy(x, p) = - inf J(x, p) = -J{C) . 



• Proof of the lower bound i2.29\) . 

We first introduce a special subset B of T as 

B = {(x,p) G T : p a G C^OjT] and p ff (t) > Vcr G T, i € [0,T]} . 

As shown in Lemma lA.31 in the Appendix, B is a dense subset of T. 

Let O be an open subset of T and fix (x*, p*) G Of)B (note that (x*, p*) exists since B 
is dense in T). Define 

V a (s) = hiz a (p* cr ( S ),x*(s), S ), (6.9) 

where z a has been defined in (I4.10p . Since rates are assumed to be C 1 (see assumption 
(A3)), since {p* (s)r(a, a'\x*(s), s)}o-,o-' belongs to the set S defined at the beginning of 
Section 0] (see assumption (A2)) and due to Lemma (|4.2p , we get that V a G C X [Q,T\. We 
take as perturbation V = {V^jo-gr- 

Due to the fact that O is open we have for any 5 small enough 

Qi,„ (O)>Qk° ( B s( x *>P*))> VA > ' 

where B$(x* , p*) is the ball in T of radius S and center (x* , p*). We now use the following 
estimate 



QL, (B S (x*,p*)) = Q X X ^ ( ^%^(s*,p*) ] > 



(x,p)eB d (x*,p*) dQ > XQ a 



Q% m {B 5 (x\p*)) f Jnf_ _ -^J^W) . (6.10) 



Due to the particular choice of V (see Section the law of large numbers stated in 
Proposition 12.21 implies that 



lim Q^ ao (B s (x*,p*)) = l. 

A — >OQ 



Hence, we can derive from (16.101) and f)6.3p that 

(x,p)eB s (x* ,p*) 



lim inf ~logQ% (O) > - sup Jy(x,p) 

A — >oo A ' 
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Due to the fact that this bound holds for any 5 small enough we also have that 

lrminf - log Q^ (O) > -lim sup Jy(x,p). 

A ^°° A s ~>° (x,p)eB s (x*, P *) 

From the continuity in (x,p) of Jy(x, p) we deduce that 

lim sup J v {x,p) = J v (x*,p*) = J{x*,p*) 

(x,p)eB s {x*,p*) 

(the last identity follows from the definition of V and the results of Section [5]) . 
Optimizing over all possible (x*,p*) G O PI B we finally get 

lim inf - log Q* (O) > - inf J (re, p) . 
A^oo A u ' u (z,p)€OnB 

In order to conclude the proof of the lower bound we only need to show that 

inf J(x,p)= inf J(x,p). (6.11) 

0r,p)eOnB (x,p)eO 

Trivially, the l.h.s. is not smaller than the r.h.s. In order to prove the opposite inequality, 
fix (x,p) G T and fix a sequence (iW^W) (= £> converging to in T. By the 

construction of this approximating sequence given in the proof of Lemma IA.31 we can 
assume that there exists a set U C [0, T] whose complement has zero Lebesgue measure 
such that pa (s) — > p a {s) and x^ n \s) — > a?(s) for all s G f7 and o" G T. Due to the 
continuity of the transition rates, this implies that 

c^(s)[a,a'] := p^\s)r(a, a'\x^(s), s) - ,» ff ( S )r(^'|x( S ), S ) =: c(s) , (6.12) 

for all s G U and all cr, a 1 G T. Recall the function J defined in (|4.ip . Section 01 Then, 
due to (|6.12p and the continuity of J (see Lemma I4TT]) . we obtain that 

j{p^(s),r(;.\x^(s),s)) = J(c^(s)) ^ J{c(s)) =j{p(s),r(;.\x(s),s)) (6.13) 

for each s &U. Since \\x^ — x||oo goes to zero as n f oo and due to the continuity of the 
transition rates, given e > we can find no such that 

sup sup supr(a,a'\x ( - n \s), s) ^ sup sup r(cr, o"'|x(s), s) + e =: C . 

n > no se[0,T] cr,cr' se[0,T] cr,a' 

Due to the definition (|2.24p of j, this implies that 

(j{pM(s),r(;.\x^(s),s)) <C|lf, 

\i(p( S ),r(vW S ), S )) ^ c|r| 2 , 1 ' J 

for all s in [0, T] and n no- Now, due to (16.131) . (16.141) and the dominated convergence 
theorem we can conclude that 

T f-T 



j(xW,pW)= J j{p^(s),r(;-\x^\s),s))ds^ I j(p( S ),r(;-\x(s),s))ds = J(x,p) 
thus implying ()6.1ip . 
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7. Proof of Theorem 12.51 

We first prove that the family -R^ 0iO - is relatively compact and then characterize its 
limit points. 

• Relative compactness. We use Prohorov theorem and Aldous compactness criterion (see 
for example [KLJ [Section 4.1]). Since is compact (endowed with the discrete topology), 
we only have to check that 

(1) For each t G [0, T] and e > 0, there exists a compact Kcl <i such that 



R 



A 

X ,<T 1 



(x(t) €K) = (z(t) €K)^£, VA > , 



(2) and that 



lim lim sup sup R 

910 AToo n 



A 

20, (TO 



x(t) -x((t + 6)AT)\ > e 



or a(r) / a((r + 6>) A T) ) = 



(7.1) 



(7.2) 



where r varies among all stopping times bounded by T. 
As observed in Lemma IC.ll there exists a compact K C M rf such that x(t) G JC for all 
t G [0,T] P^ 0(T0 ~a.s. and for all A > 0. Since — x(s)| = |J P CT ( U ) (x(u), , we 
conclude that there exists a positive constant c > such that \x(t) — x(s)\ ^ c(t — s) for 
all s < t in [0, T], P£ -&.s and for all A > 0. Hence, we only need to prove that 



lim lim sup sup R x ( a(r) ^a((r + 6) AT 

y i0 Atoo r \ 



0. 



Below we restrict to 9 G [0, 1], moreover we use the shorter notation tq := (r + 1 
can write 



< i( ro(«( T )^«(( T + e ) AT ))=<, 



P; 



air) / a(r e ) | x(r),a(r),r 



(7.3) 
AT. We 

• (7-4) 



Due to the strong Markov property of PDMPs, we can bound 



x ,a 



(a(r) / a(r e ) | x(t) = x, cr(r) 



t) € 



Xo,<7Q 



(3s G (r, rg] s.t. a(s) ^ a(r) | x(r) = x, cr(r) = a,r = t) ^ 

P£a,t (3s G (t, (t + 6) A T] s.t. a(s) r a(<y) ) , (7.5) 

where P^at denotes the law of the A-rescaled PDMP starting in (x, a) at time t. 

Due to the discussion at the beginning, we know that x(r) belongs to /C, thus imply- 
ing that in the above expression we can restrict to points x belonging to /C. Similarly, 
starting in x G K the A-rescaled process with law P£ at cannot leave a fixed compact K! 
(independent of A, x, a, t) in time 9^1. Hence, defining 

c := sup sup max > r(o"i, &2\x', u) , 

x'£/C'nG[0,T] CT i er „ Jrf . 

1 ' ' CT2fcI :<T2^:(Ti 

the number N of chemical jumps for the process P^at i R ^ ne interval (t, (t + 9) A T] is 
stochastically dominated by a Poisson variable N of mean c\9, uniformly in (x,a,t) G 
K, x r x [0, T] and A ^ 1. By similar arguments, whenever the process with law P^ at 
makes a chemical jump in the time interval (t, (t + 9) A T], the probability that the jump 
is between different chemical metastates is bounded from above by C/A, C not depending 
on (x,a,t) G K. x V x [0, T], A ^ 1. Therefore, conditioned to make n chemical jumps in 
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the time interval (t, (t + 6) AT], the probability that at least one jump is between different 
chemical metastates is bounded from above by Cn/X. Hence, we can estimate 

P^ t (3s E [t, (t + 9) A T] s.t. a(s) G* T a(a} ) ^ 

oo oo 

J2Px,a,t( N = n)Cn/A< ^P(N = n)Cn/\= (C/\)E{N) = cC 6 . (7.6) 

n=l n=l 

This allows to bound the r.h.s. of (|7.5I) by cC9 uniformly in A ^ 1, thus implying the same 
bound for the first expression in (|7.4p . This concludes the proof of (17. 3D and therefore the 
proof of the relative compactness of {R^. Q <j }a>o- 

• Characterization of the limit points. Given a path c(i), define the times T\,T2, . . . as 
the consecutive times in [0, T] at which the system jumps between different metastates, 
i.e. 

Ti = inf {t G [0,2] : a(a(t)) + a(a(0))} , 

T k = inf {t G (T fe _!,T] : a(a(t)) + a(a(T k ^))} , k^2, 

with the convention that T k = oo if k is larger than the number of jumps in the time interval 
[0, T] between different metastates. Fix (xo, &o) £ K d x T, a sequence < t\ < t2 < ■ ■ ■ < 
t n < T and fix a±, 02, . . . , o n such that a{pi) 7^ a{oi + \) for each i = 0, 1, . . . ,rt — 1. In 
addition, fix 5 > and e > small enough that e < T — t n and e < ti + \ — ti for each 
i = 0, 1, . . . , n — 1, where to := 0. Then define the event 

A = {T k G (t fc -£,ifc + e) and cr(T fc ) = cr fc , VTc = 1,2, ... ,n} n { sup |z(t) - < 5} , 

t^T n 

(7.7) 

where the path (x*(i) : i G [0,T n ]) is the only continuous path in M. d such that 

xS) = F a{ak) (x*(t),t) Vt G [T k ,T k+1 ], fe = 0,l,...,n-l. (7.8) 

In the above formula To := and the vector field Fi for 2 G is the one defined in 
(pT33j) . We claim that 

„ n— 1 

lim P X A CT0 (.4) = / d Ul du 2 . • • dun TT fe" ^ 7«c«r fc) (*.(«).<)* x 

^ a ( CTfe )(5A : |x*(u fc+ i),u fc+ i)r(3 : fc ,cj fc+ i|2; i) ,(-u fc+ i),u fc+ i)^ , (7.9) 

s : feer Q(CTfe) 

where no := 0, U := 11?= 1 ~~ e > *t + e ) an d 

7i(x,s):= i G . (7.10) 

We first prove the above claim for n = 1. For simplicity of notation we write t in place 
of t\ and a 1 in places of cj, while we call gq, a±, . . . , o> the finite sequence of states in 
r Q (o- ) visited by the process before jumping to a'. Then, defining now 

A= {Ti g (t-e,t + e),a(T 1 ) = a' , sup - x*(s)| <jl , (7.11) 
I s < Ti J 
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we can write 



\su pU pU pU 

P L^ A )=H E / du dn dr 2 --- dr r 

r=0a 1 ,a 2 ,...,Vr Jt - £ J J Tl J T ^ 

r x r -> f Tk + 1 1 
exp {~ 2_, / [ X %k( x ( s )> s ) +ba k (x(s),s)]ds\ 

;.,_n J Tk 



k=0 JTk 

J\ ^r(a k ,cr k+ i\x(Tk+i),T k+ i) 



r-l 



.k=0 



r(a r ,a'\x(u),u)x I sup \x(s) — x*(s)[ < 5 ) , (7.12) 



where in the above expression tq : = 0, r r+ i := u, {x(s) : s 6 [0,ii]} is the only continuous 
path on [0, u] starting in xq such that 

x(s) = F ak (x(s),s) , Vs G (r fe ,Tfc + i) , V/c = 0, 1, . . . , r 
and, for a G T a ^ o) , 

%(x,s)= ^2 r(a,a\x,s), 
s : er Q(CTo) 

bcr(x,s)= ^2 r(a,a\x,s). 

CTer\r Q(<To) 

Let us call Px ,a the A-rescaled PDMP with chemical states in r a ( CT0 ), transition rates 
Xr(a,a'\x,s) and vector fields F a (x,s), a, a' € ^ a (a )- We write E% oao for the associated 
expectation. Then it is simple to check that the r.h.s. of (|7.12p equals 

Ex ,a j duexpl-f b a{s) {x(s),s)ds\ r(a(u),a'\x(u),u)x{sup \x(s) - x*(s)\ < 5) 

Ut-e I JO ) s^u 

(7.13) 

(Above we have used that a(u) = a(u—) P£ CT -a.s.) One can compute the limit of (17.130 
as A | oo by means of the LLN given in Theorem 12.21 applied to P£ aQ . Indeed, we know 
that for each > P% ](70 (sup s <^ t +e \ x ( s ) ~ x *( s )\ < 0) ~ * 1- This allows to write 



X0,CT0 



t+e 



t-e 



du exp < - / b a ( s )(x*(s),s)ds > r{a{u),a'\x 1r (u),u) 



+ o(l), 



where here and below we denote o(l) any quantity such that 

limlimsupo(l) = 0. 

PiO AToo 

It is simple to derive from Theorem I2.2I that 



lim P, 



x 



sup 

t—e ^ u < t+e 



Af oo 

since (recall (I7.10P ) 



>I3 =0, 



MaH)^*^)' 5 )^^*^),^) • 



(^o) 
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Hence we can write 



TO 



t+e 



du exp 



t-e 



la(a ){x*(s),s)ds \ r(a(u) , a'\x*(u) ,u) 



+ o(l), 



At this point, one can apply again Theorem 12,21 and conclude that 



t+e 



7a(a )(x*(s),s)ds \ /I a ^ ($\ X* (u) , u)r (<7, O \x* (u) , ti)+o(l) . 



/ (in exp 

T6I a{CTo) 

By taking the limit A f oo and afterwards using the arbitrariness of /3, we then obtain 

A [oo 



E 



?er. 



(in exp 



a(cr ) 



t-e 



(7.14) 

This concludes the proof of (|7.9[) when n = 1. Let us now show how to prove (|7.9I) when 
the event „4 is defined as in (j7.7H with n = 2. The general case is completely similar. By 
the strong Markov property, we can write 

P^ ao (A) = E xo,*o \x{Ti £ (h -e,h+e), <r(Ti) = a 1} 

, , 1 (7.15) 

sup |i(i)-i,(t)|<« / A (x(ri),<7i,Ti) , 
t < Ti J J 

where, for s ^ t 2 — £, 

f x (x',a',s):=P x , a , s (T 1 e(t 2 -e,t 2 + e), £ t(T 1 )= ( j 2 , sup \x(t) - z*(t)\ < S) , 
v s < t < Ti 7 

being the path starting in x' at time s, such that £*(t) = i^,^ Due to 

(17.14ft with modified starting state and starting time, we know that f x (x', a', s) converges 
to g(x' , a\ s) defined as 



g(x',a',s) := 



E 



t 2 +e 



du exp 



t 2 -e 



7a(a')( x *{ s ), s ) \ /^a( ( 7')( S: | X *( n )'' U ) r ( S: ' Cr2 l X *( U )' n ) • ( 7 - 16 ) 



By simple arguments (as the ones used in the proof of Lemma l5.ip one can improve (17.141) 
and conclude that, given a compact /C, 



lim sup 

A T°° x'eK,a'€T,se[a,t 2 -e] 



f x (x',a',s) - g(x',a',s) 



0. 



This allows to replace in (|7.15|) . f x (x{T\), a\, T\) with g(x(Ti), a\, Ti) plus a negligible 
error as A | oo. The conclusion of the proof of (|7.9p for n = 2 follows now from the LLN 
of Theorem 12.21 by the same arguments used in the proof of (|7.14|) . 

Having proved (|7.9p . we derive from it the following fact. Fix (xo,ao) € R d x T, a 
sequence < t\ < t 2 < • ■ ■ < t n < T and fix i\, i 2 , ■ ■ ■ , i n G such that ^ ik+\ for 
each k = 0, 1, . . . , n — 1 (io ■= a(cr )). In addition, fix 5 > and e > small enough that 
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e < T — t n and e < ij+i — ti for each i = 0, 1, . . . , n — 1 where to := 0. Then define the 
event C = C(e, 5) as 

C = {T k G (t k — e, t k + e) and a(a(T k )) = i k , VA; = 1, 2, . . . , n}fl{ sup jx(i) — < 5} , 

t s: T n 

(7.17) 

where the path (x*{t) : t G [0,T n ]) is the only continuous path in M. d such that 

x*(t) = F ih (x*(t),t) Vt G [Tfc, Tfc +1 ], fe = 0, 1, . . . ,n— 1. (7.18) 
Then, summing in (|7.9I) over a%, o"2, . . . , cr n , we obtain 

n— 1 

limP :r A 0(T0 (C)= / dn 1 dn 2 ...(iu n r[ ( e -^' +1 ^^( s ^r(i fc , |x,(n fc+1 ), n fc+1 )) . 

(7.19) 

Since C is an open subset of the Skohorod space D([0,T],R d x rW), we derive that for 
any limit point 7Z of the family {7^ a(a ) : > 0} the probability 1Z(C) is not larger than 
the r.h.s. of (17.190 . By similar arguments, one obtains that the limit P% ao (C) coincides 
with the r.h.s. of (|7.19p . where the event C = C'(e,5) is denned as 

C = {T k G [tk - e,t k + s] and a(a(T k )) = i k ,Vk = 1,2, . . . ,n}n{ sup \x(t) — x*(t)\ ^ 5} . 

t^T n 

(7.20) 

Since C is closed, we derive that 7Z(C) is not smaller than the r.h.s. of (|7.19p . On the 
other hand, C'(e',5') C C(e,5) for e' < e and 5' < 5, hence TZ(C'(e', 6')) ^ K(C(e,6)). By 
taking the limits e' — > e and 5' — > 5, the above observations implies that 

K{C) = / du x duv...du n \[ (e-^ 1 ^^W' s ) d V(i fc ,^ 1 |x*(« i:+1 ),« fc+1 )) . (7.21) 
Ju k=0 

The above family of identities parameterized by t\, ... ,t n , e and 5 allows to conclude 
that there exists a unique limit point and it must coincide with the law of the PDMP 
described in Theorem 12.51 

Appendix A. Some topological properties of the space T 

For the reader's convenience, in this Appendix we collect some properties of the metric 
space T that are used in the text. We stress that the definition of T given in (|2.2U|) 
depends on the fixed initial mechanical state xq. We call .M*[0, T] C M[0, T] the image of 
the map L[0,T] 3 f -> f(t)dt G M[0,T] and we define .M*[0,T] r ' 1 as the set of positive 
measures (p ( r(t)dt) (Jgr such that X^o-er Po-(i) = 1 o.e. 

Lemma A.l. Given p G A1*[0, T] 1 "' 1 , there exists a unique x{t) G C[0, T] such that 

x(t) = x + V I F a (x(s), s)p a (s)ds Vt G [0, T] . (A.l) 

Moreover, the map that associates to each p G .M^O, T] 1 "' 1 the unique element x(t) G 
C([0,T]) satisfying (lA.ip is continuous. 

Proof. Due to (12. 8p . if x(t) solves (lA.ip it must be \x(t)\ ^ \xo\ + cit + C2 Jq \x(s)\ds. Then, 
applying Gronwall inequality, the path x(t) must lie inside a compact /C, depending only 
on xq. We fix the constant K as in (12. 7p . 
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Let us define Q as the subset 

Q : = { p G M*[0, if' 1 : p a G C[0, T] V<7 G T} . 

It is simple to check that Q is dense in .M^fOjT] 1 "' 1 . Indeed, by using mollifiers, one 
can show that for each a G T there exists a sequence Pa\s) G C[0, T] such that pi (s) 
converges to /9<j(s) in L l [0, T] as n j oo. At cost to normalize, we can assume that 

EaP^i 8 ) = l for each sG [0,T]. 

If p G Q, existence and uniqueness of ([A.ip can be proven by the same arguments used 
in the proof of Lemma 12.11 given in Appendix O In order to prove existence for (jA.ip 

when p G .M*[0, if' 1 , we take a sequence p^ G Q such that p^ 1 ' converges to p a in 
L^O, T] as n | oo. Consider the solutions x^ n \t) G C[0, T] associated to p( n > . We can 
bound 



<rer 



-pW( S )]F ff (,W( S ),^ < K X Y, f T W ) {s)-p ( r\s)\ds =: C n , m , 

JO ctGT 

where -fTi := max„ max^g^ ,tg[o,T] l-^o-(^>i)|- Due to (12. 7p we can estimate 

M»)(t) - x (m) (t)| C n , m + i^ f\x^ n) {s) -x {m) {s)\ds. (A.2) 



Due to Gronwall lemma, we conclude that \\x^ n \t) - a;( m )(t)||oc sC C n . m e . Since C n m 
is arbitrarily small for n, m large, we conclude that the sequence x^ is a Cauchy se- 
quence in C[0, T], and therefore it converges to some path x G C[0, T]. Taking the 
limit n — > oo for equation (lA.lj) with x,p replaced respectively by x^ n \ p^ n \ due to 
the Dominated Converge Theorem one concludes that x(t) solves (jA.ip . Uniqueness fol- 
lows from Gronwall inequality, since given two solutions xi(t) and X2(t) of (jA.lj) it must 
be \x\(t) - x 2 (t)\ ^ K J Q \xi(s) - x 2 (s)\ds. 

Finally let us prove the continuity of the map M^Tf' 1 3 p{t) -f x(t) G C[0,T]. We 
introduce a metric D on .M*[0,T] defined as 



D{fi(t)dt, h(t)dt) = sup 
te[o,T] 



[/i(*)-/ 2 00]<fe 



/i,/ 2 ei[0,T]. (A.3) 



It is simple to check that D is a distance on .M*[0, T]. We claim that the topology induced 
by D coincides with the weak topology of [0, T] . To this aim, we only need to show that 
D(f n (t)dtJ(t)dt) -» Otf and only if g f n (t)g{t)dt -» J Q T f(t)g(t)dt for each 5 G C[0,T]. 
Given /i G £[0,T] let /i(t) = £ h(s)ds for i s$ T. Since /i is a function of bounded 
variation, it is simple to check that D(f n (t)dt, f(t)dt) — > if and only if f n (t) — > f(t) for 
each t G [0, T]. The proof that the weak convergence f n (t)dt — > f{t)dt coincides with the 
pointwise convergence of f n to / follows the same arguments leading to the equivalence 
between the weak convergence of probability measures and the pointwise convergence of 
the associated distribution functions. 

Take a sequence p^ G .M*[0, T] 1 "' 1 converging to some p G A4*[0, T] r>1 . Consider also 
the corresponding x^ n >(t), x(t) G C[0,T] obtained from (jA.ip . Setting 



Cn(t) := [\p^(s)-pAs)]F (7 (x(s),s)ds 
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due to (12. 7|) in assumption (A4) we have 

\x( n \t)-x(t)\^C n (t) + J2 f P i J l) (s)\F a (x(s),s)-F (T (xW(s),s)\ds^ 

*er Jo 



C n {t) + K f \x<ri (s) - x{s)\ds . (A.4) 
Jo 



Since p'^ l \s)ds weakly converges to p a (s)ds on [0, T] and therefore on [0, t] and since 
F a (x(s), s) is continuous in s, from the previous results on the metric D we conclude that 
C n (t) — > as n — > oo uniformly in t G [0, T]. Due to the above observations we conclude 
that for each 5 > there exists uq such that for each t G [0, T] and n ^ no it holds 

\x^ n \t) - x{t)\ + K I \x (n \s) - x(s)\ds . 

Jo 

By Gronwall lemma it follows that \\x^ — x||oo ^ 5e KT for all n ^ n$. This implies that 
x^ n \t) converges to x(t) in the uniform norm of C[0, T]. 

□ 

Lemma A. 2. The space T is a compact Polish metric space. 

Proof. First we prove that A4*[0, T] T,X is compact. It is a subset of the compact space 
{p G Ai[0,T} r : p a [0,T} ^ T Va 6 T}, so that we just need to prove that it is closed. 
We first prove that A1*[0, T] is closed. To this aim, let p n be a sequence in A4*[0, T] 
converging to p G M[0,T\. Since given g G C[0, T] it holds \p n {g)\ ^ Jq \g(t)\dt, by 
taking the limit we conclude that ^ HffllzAfo.T]- By density we obtain that the map 

L 1 [0, T] 3 g — > p(g) G R is a continuous linear functional with norm bounded by 1. Since 
the dual space of L 1 [0,T] is given by L°°[0, T] endowed of the essential uniform norm, we 
can conclude that there exists h G L°°[0, T] with ||/i|[oo ^ 1 such that p(g) = J Q g(t)h(t)dt 
for all g G C[0,T]. Since p(g) = lim n | 00 p n {g) ^ for all g G C[0, T] with g ^ 0, the 
function h must be nonnegative a.e. This proves that p G A^*[0, T] and dp/dt = h. Hence 
A1*[0,T] is a closed subspace of A4[0,T]. Consider now a sequence p( n > G A'i^fO, T] 1 "' 1 
converging to p. Then necessarily for every a G T it holds p a G A'UfOjT]. Moreover for 
each j£C[0,T] it holds 



[ g(s)ds = Y / [ P { J l \s)g(s)ds^J2 I P^)g(s)ds = [ I £ p a (s) ) g(s)ds . 
This implies that 



£ g(s)ds = jf (j2 Pa(s) ) g(s)ds , V 5 G C[0, T] 




Hence, X^o-er /^(s) = 1 a.s. and this means that p G A^^fO, T] r>1 . 

Compactness of T C A4[0,T] x C[0,T] follows from the fact that it is the graph of a 
continuous function defined on a compact domain A'UfOjT] 1 "' 1 C A4[0,T]. Completeness 
and separability of T follow from the fact that T can be thought as a closed subset of the 
space C[0,T] x A4[0,T] r , which is complete and separable. □ 

Lemma A. 3. The set B defined as 

B = {(x,p) G T : p a G C^T] and p a (t) > V<7 G T, t G [0,T]} 
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is a dense subset of T . 

Proof. Fix (x,p) € T. Then, by using mollifiers, one can show that for each a € T there 
exists a sequence Pa(s) G C^OjT] such that Pa(s) converges to p a {s) in i/^O, T] as 
n | oo. At cost to take max{l/ra, p^ 1 (s)} we can assume that p& is positive; at cost to 

normalize, we can assume that J2 a P^\ s ) = 1 f° r each s € [0, T]. Since L 1 -convergence 
is stronger than L[0, T] -convergence (where L[0, T] is endowed with the metric defined by 
the r.h.s. of (|A.3|) ). we obtain that p%r converges to p a in L[0,T] as n f oo. Let us call 
the solution of the Cauchy problem 

x (n) (t) = E„erP« ] (t)FM n) (t),t) t € [0,T] , 
X W(0) =x . 

Note that is well defined due to Lemma lA.ll Then {x^ n \ p^) belongs to B and from 
Lemma lA. II we have that \\x^ — x||oo — * 0. □ 



Appendix B. A uniform large deviation estimate 



In this appendix we prove formula (15,130 . keeping the same notation introduced in the 
proof of Lemma [5, 11 Formula (|5.13|) follows immediately from the next lemma, valid under 
the assumptions stated in Section El 

Lemma B.l. For any 5 > it holds 



lim sup sup 

«^oo (x,t)eK.'x[o,T], o-.o-'er 

1 



- In Qa'x.t 
u 



o IS 



p(a\x, t)] ds 



> 5 



<0. (B.l) 



Proof. We fix some notation. We call p^ the empirical measure in the time interval [0, u] 
defined as 

1 f u 

x(cr(s) = a)ds Ma G T . 



» - 



This is an element of 7W 1 (r), the set of probability measures on V. Moreover, we write 
£ := K' x [0,T] x M l (T). Note that S is a Polish space. For any fixed a' £ T and 
for any time u we call Q", the map that associates to any measurable subset S C E the 
nonnegative number 



Q u AS)-.= sup Q<T>, x M(x,t,pM)es\) 

(x,t)eK'x\0,T] Vl J/ 



SUp Qa^xAp^ € 

(i,t)e/C'x[o,T] v 



(x,t)eK'x[0,T] 

where S {x jy.= {peM l (T) : (i,i,p)e5}. 

In order to obtain upper bounds on Q™,(S), we proceed as follows. Given an arbitrary 



function V : T — ► R we introduce, likewise in (|6.ip . the perturbed rate for a jump from cr 
to another chemical state a' as 



r v (a,a'\x,t) := r(a,a'\x,t)e 



(B.2) 



The law of the Markov chain on T with the above perturbed rates and with initial condition 
a' is called Q^, x t . Using a result analogous to (16. 3p in this simpler framework and using 
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the notation introduced in Section [U we obtain that 

limsup — In Q", (£) =limsup— sup In Qa\x,t(p^^S( xt \ 
u _>oc U L J u-^oo U ( Xt t)^K'x[0,T] L ' V 



lim sup — sup In 

u^oo U ( x> t)eK'x[0,T] 

1 



E, 



dQ a < 



x,t 



X 



G 5, 



(x,t) 



^ lim sup — sup In 



sup 



inf inf J[ c[p,r(-, -\x,t)],e 

(x,t)eK'x[o,T] P eS (Xtt) 1 



V 



inf J" c[p,r(-,-|x,t)],e 
(x,t,p)eS 



V 



We can now optimize over the arbitrary functions V obtaining 

lim sup — In Q u , (S) ^ —sup inf J (c[p, r(-, -\x, t)], e v ) 
u v {x,t,p)eS 



(B.3) 



We note that given a compact subset C C £ a finite open cover Ox,..., O n of C, it trivially 
holds that Q™, (C) ^ Ya=i Q&> (Qi)- Hence we can estimate 

limsup — In Q",(C) ^ inf max inf sup — J (c[p, r(-, -\x, t)], e v ) , (B.4) 

u^oo u ' O lt -,Onl «£j <n V (x,t,p)eOj 

where the first infimum is carried over all finite open covers {Ox,02, ■ ■ ■ ,O n } of C. In 
order to bound the above r.h.s. we can apply Lemma 3.2 in [KL] [Appendix 2]. Indeed, 
the assumption of this lemma are fulfilled since, as composition of continuous functions 
(see Lemma l4.ip . the map 

£ 3 (x,t,p) e £ -> J (c[p,r(-,-\x,t)],e V ) G M 
is continuous for any V. As result we obtain that 



lim sup — In Q u , (C) ^ — inf swpJ'(c[p,r(-,-\x,t)],e v ) = 

u (x,t,p)ec v 

- inf j(p,r(;-\x,t))=j(p*,r(-,-\x*,t*)), (B.5) 

(x,t,p)ec 

where (x*,t*,p*) is a minimum point of the continuous function (x, t, p) — > j (p, r(-, i)) 
on the compact set C. 

The statement of the lemma now follows from two simple facts. First: since the map 
(x, t) G K! x [0, T] — > p(-\x, t) G M l (T) is continuous we have that for any fixed a G T the 
set 

C := {(x,t,p) G /C' x [0,T] x M x (r) : |p ff - fi(a\x, t)\ > 6} 

is compact. Second: from Remark l4.3l we have that the continuous function j (p, r(-, - \x, t)) 
is strictly positive on C and therefore also its minimum. 

□ 
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Appendix C. Miscellanea 

In this last appendix, we prove Lemma 12.11 and we collect some technical results fre- 
quently used in the paper. 

Proof of Lemma 12.11 We consider here only (|2.15p . since the Cauchy problem (|2.14|) 
can be treated similarly. First, we observe that due to (|2.12p the field F(x, t) is continuous 
on R d x [0,T], is locally Lipschitz w.r.t. x and satisfies (|2.8|) with F instead of F a . Then, 
due to Picard Theorem, the Cauchy problem (|2.15|) has locally a unique solution. We 
only need to show that there exists a global solution on [s,T]. Given b > we define 
M(b) = m&x{\F(x,t)\ : \x — Xq\ ^ b, t G [0, T]}. Then by Peano Theorem, there exists a 
C 1 solution x(t) of (|2.15p defined for t G [s, s + a], where a := min{T — s, b/M(b)}. Due 
to (|2,8p . we know that 

b/M(b) ^ b/(Ki + k 2 \x \ + K 2 b) . 
We take b = b(xo) large enough that b/M(b) ^ 1/(2^2). This implies that the solution of 
(I2.15P exists always on the interval [s, (s + l/(2«2)) A T], which does not depend on xq. 
By patching a finite number of paths, one obtains the global solution of (|2.15p . 

□ 

Let us now show another consequence of Assumption (A4): 

Lemma C.l. Given a an element of D([0,T],T) and given s G [0,T], let x(t\xo,s) be 
the unique continuous and piecewise C 1 solution on [s,T] of the ODE x(t) = F a ^{x{t),t) 
starting at xq at time s. Then, for each compact subset JC C M rf there exists another 
compact subsect K' C M. d , independent from the path cr{t), such that 

{x{t\x , s):s^t^T, Xq G /C} C K! . 

The same thesis holds if one replace x(t\xo,s) with the C 1 solution x*(t\xo, s) of the ODE 
x*(t) = F(x*(t),i), starting at xq at time s. 

Proof. We give the proof only for x(t\xQ,s) since the other case can be treated similarly. 
Due to (12.81). we can bound 



|x(t|xo, s)| ^ |xo| + / \F a ( u }(x(u),u)\du ^ \xq\ + K\(t — s) + k,2 / \x(u\xq, s)\du . 

J s J s 

Due to the Gronwall inequality, the l.h.s. is therefore bounded by (\xo \ + K\T)e K2T , thus 
implying the thesis. □ 

Lemma C.2. Assumptions (A2) and (A3) imply that n{a\x,t) is a C 1 function in x and 
t, for each a G T. 

Proof. We fix (xo,io) G M d x [0,T]. By assumption (A2) and Perron-Frobenius Theorem, 
the right kernel of the matrix L c (xo,to) nas dimension one and is generated by the row 
n(-\xo,to) (below, we will play with row and column vectors, the interpretation will be 
clear from the context and will be understood). Hence L c (xo,to) nas rank n — 1, where 
n := In particular, there exists <7o G T such that all the cr-columns V\,V2, ■ ■ ■ ,v n -i, 
with o~ ^ (To, of the matrix L c (xo,^o) are independent. We define it as the canonical 
projection ir : M r _>Rr\{*o}_ Then 

we consider the map 
F : R d x [0, oo) x R r 3 (x, t, z) -> (ir(z ■ L c (x, t)), ^ z a fj,(a\x , t ) - a) G R r , 

where a = [i(a\xo, to) 2 - Note that F is C 1 and that F(xQ,to, Zq) = where zq := 
mOI^Oj to)) ■ We claim that the map F(xo,to, •) has invertible tangent map T z F(xq, to, zq) 
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in zq. Indeed, T z (xo, to, Zq) maps z G M r in z ■ A G R r , where A is a T x T-matrix whose 
columns are given - a part the order - by v±, V2,--- , v n -\ and z$. We already know 
that vi, . . . , v n -\ are independent. Moreover, since zq ■ L c (xq, to) = 0, v±, . . . , w„_i are all 
orthogonal to zq- This implies that all the columns of the matrix A are independent, and 
therefore A is invertible, thus proving our claim. 

We can now apply the Implicit Function Theorem and derive that there exists an open 
neighborhood U of (xo,to) and a C 1 map h : U such that F(x,t, h(x,t)) = for all 

(x,t) <G U. This implies that (h(x,t) ■ L c (x,t)) a = for all a / ao- Since L c (x,t) -1 = 0, 
we know that 

^2(h(x, t) ■ L c (x, t)) a = h ■ L c (x, 0-1 = 

thus implying that (h(x,t) ■ L c (x,t)) ao = 0. Moreover, since h(x,t) ■ zq = a / 0, we 
conclude that h(x, t) is a nonzero right eigenvector of L c (x, t) with eigenvalue 0. By 
Perron-Frobenius Theorem we have that 

H(a\x,t)= k ^ X f V(x,t)€U. 

}2 a > K>(x,t) 

The above identity and the fact that h is C 1 imply that n(a\-, •) is C 1 . 

□ 
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